-- Logs begin at Thu 2022-03-10 16:40:08 UTC, end at Thu 2022-03-10 17:45:01 UTC. -- Mar 10 17:10:02.248761 dv-cinder-830538-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 10 17:10:02.256041 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 10 17:10:02.258048 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Mar 10 17:10:02 2022] *** Mar 10 17:10:02.258048 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 10 17:10:02.258048 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 10 17:10:02.258048 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: nodename: dv-cinder-830538-8-iscsi Mar 10 17:10:02.258048 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: machine: x86_64 Mar 10 17:10:02.258404 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: clock source: unix Mar 10 17:10:02.258404 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: pcre jit disabled Mar 10 17:10:02.258404 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: detected number of CPU cores: 4 Mar 10 17:10:02.258404 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: current working directory: / Mar 10 17:10:02.258404 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: detected binary path: /usr/bin/uwsgi-core Mar 10 17:10:02.258404 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: your processes number limit is 47680 Mar 10 17:10:02.258404 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: your memory page size is 4096 bytes Mar 10 17:10:02.258404 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: detected max file descriptor number: 2048 Mar 10 17:10:02.258404 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: lock engine: pthread robust mutexes Mar 10 17:10:02.264323 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: thunder lock: enabled Mar 10 17:10:02.264323 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 10 17:10:02.264323 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 10 17:10:02.306207 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: Python main interpreter initialized at 0x564ca879d9c0 Mar 10 17:10:02.306207 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: python threads support enabled Mar 10 17:10:02.306207 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: your server socket listen backlog is limited to 100 connections Mar 10 17:10:02.306207 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: your mercy for graceful operations on workers is 90 seconds Mar 10 17:10:02.306509 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: mapped 403077 bytes (393 KB) for 2 cores Mar 10 17:10:02.306612 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: *** Operational MODE: preforking *** Mar 10 17:10:02.306899 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: *** uWSGI is running in multiple interpreter mode *** Mar 10 17:10:02.306899 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: spawned uWSGI master process (pid: 79392) Mar 10 17:10:02.307094 dv-cinder-830538-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 10 17:10:02.310133 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: spawned uWSGI worker 1 (pid: 79405, cores: 1) Mar 10 17:10:02.310133 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: spawned uWSGI worker 2 (pid: 79406, cores: 1) Mar 10 17:10:02.310133 dv-cinder-830538-8-iscsi devstack@keystone.service[79392]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 10 17:10:08.063026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 10 17:10:08.063026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: from cryptography.utils import int_from_bytes Mar 10 17:10:08.063787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 10 17:10:08.063787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: from cryptography.utils import int_from_bytes Mar 10 17:10:08.066712 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 10 17:10:08.066712 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: from cryptography.utils import int_from_bytes Mar 10 17:10:08.067150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 10 17:10:08.067150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: from cryptography.utils import int_from_bytes Mar 10 17:10:08.108449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 10 17:10:08.108660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 10 17:10:08.108818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] command line args: [] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 10 17:10:08.109087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 10 17:10:08.109270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ================================================================================ {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 10 17:10:08.109524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] admin_token = **** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.109771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] config_dir = [] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.109852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 10 17:10:08.109991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.110077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 10 17:10:08.110181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] config_source = [] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.110249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] command line args: [] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 10 17:10:08.110307 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] debug = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.110474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 10 17:10:08.110560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.112772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ================================================================================ {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 10 17:10:08.112772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] admin_token = **** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.112888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.112946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] config_dir = [] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] config_source = [] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] debug = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113394 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] list_limit = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] log_config_append = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] log_dir = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] log_file = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.113962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.114019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.114076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] list_limit = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.114539 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.114738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] log_config_append = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.114935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.115125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.115314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.115506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] log_dir = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.115728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.115900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] log_file = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.116092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.116288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.116484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.116684 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.116907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.117114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.117276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.117470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.117669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.117863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.118704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.118875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.119068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.119256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.119443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.119636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.119844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.120006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.120143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.120313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.120313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.120615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.120748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.120874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] publish_errors = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.121006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.121140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.121297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.121435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.121435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.121690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.121817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.121817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.122061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.122061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] publish_errors = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.122341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] standard_threads = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.122475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.122694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.122862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.122989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.123122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.123264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.123264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] use_journal = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.123518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.123651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] use_json = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.123777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.123902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] use_stderr = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.123902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] use_syslog = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.124152 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] standard_threads = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.124279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.124411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.124411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.124648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.124781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.124913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.125045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] use_journal = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.125176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.125318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] use_json = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.125318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] use_stderr = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.125563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.125690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] use_syslog = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.125821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.125953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 17:10:08.126078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.126234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.126371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.126498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.126624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.126755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.126881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.127016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.127213 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.127341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.127469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.127600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.127726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.127860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.127986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.128112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.128237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.128362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.128494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.128628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.128760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.128901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.129040 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.129168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.129293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.129427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.129556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.129687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.129814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.129946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.130073 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.130241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.130371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.130496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.130634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.130766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.130892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.131028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.131154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.131286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.131418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.131544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.131670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.131804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.131931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.132056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.132182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.132317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.132442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.132578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.132706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.132832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.132963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.133096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.133226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.133430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.133559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.133686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.133813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.133945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.134071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.134310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.134440 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.134566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.134691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.134817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.134943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.135077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.135203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.135328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.135454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.135579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.135710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.135710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.135959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.136095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.136221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.136352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.136486 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.136611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.136736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.136861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.136992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.136992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.137234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.137360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.137485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.137610 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.138843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.139023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.139263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.139426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.139615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.139615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.139980 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.140167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.140389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.140555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.140807 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.141004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.141172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.141374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.141598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.141769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.141769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.142188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.142188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.142522 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.142751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.142914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.143106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.143296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.143296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.143663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.143663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.143999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.144137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.144311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.144440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.144599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.144599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.144842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.144978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.145113 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.145113 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.145385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.145519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.145658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.145805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.145933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.146061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.146218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.146348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.146474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.146645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.146779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.146912 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.147046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.147046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.147285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.147421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.147555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.147693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.147821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.147953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.148081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.148218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.148354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.148483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.148610 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.148736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.148863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.149064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.149194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.149356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.149529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.149658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.149785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.149924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.150052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.150203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.150331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.150458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.150587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.150725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.150854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.150981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.151114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.151242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.151390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.151519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.151647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.151780 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.151907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.152039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.152175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.152317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.152488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.152626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.152754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.152882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.153014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.153150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.153296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.153424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.153550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.153678 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.153805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.153931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.154066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.154243 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.154372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.154499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.154626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.154754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.154897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.155037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] auth.external = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.155166 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.155293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.155426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.155554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.155694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.155825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.155952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.156078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] auth.password = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.156206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.156332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] auth.token = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.156467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.156621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.156765 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.156908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.157037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] auth.external = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.157165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.157293 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.157428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.157565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.157695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.157823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.157952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.158080 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] auth.password = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.159211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.159356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] auth.token = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.159487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] credential.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.159627 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.159627 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.159870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.160034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.160166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.160295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.160422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.160550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.160677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.160871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.161014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.161151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.161280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.161408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] credential.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.161408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.161788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.161943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.162076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.162247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.162377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.162505 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.162644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.162774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.162902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.163030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.163164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.163294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.163429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.163569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.163704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.163845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.163977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.164106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.164310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] federation.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.164461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.164592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.164720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.165340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.165471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.165607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.165736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.165874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.166003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.166148 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.166284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] federation.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.166487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.166619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.166747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.166875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.167003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.167138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.167279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.167416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.167545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.167672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.167811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.167939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.168075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.168211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.168346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.168480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.168608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.168736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.168872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.169002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.169129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.169257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.169473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.169649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.169793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.169923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.170051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.170234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.170364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.170493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.170631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.170761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.170888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.171016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.171143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.171270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.171405 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.171545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.171674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.171802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.171929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.172064 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.172193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.172321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.172448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.172448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.172448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.172448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.173187 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.173321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.173460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.173588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.173716 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.173857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.173990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.174133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.174267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.174395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.174532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.174670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.174800 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.174927 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.175055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.175182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.175319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.175459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.175587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.175716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.175843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.175970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.176097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.176232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.176361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.176488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.176615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.176744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.176871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.177015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.177144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.177272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.177400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.177526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.177654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.177789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.177919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.178045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.178196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.178325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.178452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.178594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.178724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.178874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.179004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.179131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.179259 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.179394 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.179523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.179657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.179785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.179914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.180041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.180177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.180306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.180472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.181114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.181253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.181380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.181517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.181652 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.181785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.181915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.182043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.182223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.182362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.182493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.182620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.182748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.182876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.183015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.183151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.183280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.183409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.183542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.183671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.183799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.183945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.184077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.184205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.184332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.184460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.184588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.184723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.184861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.184990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.184990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.185230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.185358 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.185493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.185621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.185748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.185875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.186002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.186145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.186291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.186420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.186564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.186693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.186820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.186820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.187068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.187196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.187324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.187451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.187578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.187713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.187842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.187842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.188081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.188209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.188346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.188482 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.188611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.188739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.188866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.188993 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.189131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.189268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.189399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.189527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.189654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.189781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.189908 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.190043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.190226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.190357 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.190485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.190612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.190740 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.190878 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.191007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.191135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.191262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.191390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.191561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.191702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] resource.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.191831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.191960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.192098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.192226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.192354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.192556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.192687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.192814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.192942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.193070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.193197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.193335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.193464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.193599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.193729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.193872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.194005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.194162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.194297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] resource.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.194425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] role.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.194553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.194681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] role.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.194809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.194944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.195073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.195201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.195336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.195470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.195606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.195761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.195897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.196058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.196198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.196333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.196466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.196612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.196749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.196890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.197026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] role.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.197160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.197293 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] role.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.197434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.197580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.197716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.197851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.197985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.198168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.198321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.198458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.198592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.198726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.198726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.198987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.199123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.199256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.199390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.199534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.199668 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.199810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.199945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.200079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.200212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.200346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.200480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.200621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.200757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.200893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.201027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.201161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.201161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.201431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.201567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.201701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.201835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.201969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.202120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.202273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.202409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.202543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.202677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.202815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.202951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.203102 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.203238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.203371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.203506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.203639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.203774 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.203921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.204062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] token.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.204196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.204330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.204464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.204598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.204740 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.204886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.205021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.205156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.205290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.205424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.205565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.205701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.205835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.205969 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.206120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.206261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.206407 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.206543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.206678 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] token.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.206915 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.207083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.207231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.207367 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.207502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.207636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.207770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.207904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.208047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.208184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.208318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.208452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.208586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.208720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.208872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.209009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.209142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.connection = **** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.209290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.209435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.209570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.209704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.209838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.209980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.210133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.210274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.210410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.210544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.210677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.210833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.210969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.211109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.211244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.211379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.211513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.211684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.211825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.connection = **** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.211968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.212112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.212247 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.212383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.212518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.212671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.212808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.212943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.213077 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.213211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.213401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.213550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.213687 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.213822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.213965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 10 17:10:08.214649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.214649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.215756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 17:10:08.215756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 10 17:10:08.226170 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.226384 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.226611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.229347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.229575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.231353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.240329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.241086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.269975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.270302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.274756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.274993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.326155 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.327384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.377386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.377612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.377857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.378017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.446648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.446870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.446984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.447095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.447180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.447313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.447396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.447529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.447614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.447742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.447824 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.447962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.471950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.472181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.472273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.472406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.472490 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.472625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.472717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.472846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.472932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.473048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.473128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.473259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.473341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.473469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.485091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.485524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.497867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.498096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.498194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.498347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.498429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.498566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.498664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.498781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.498864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.498993 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.499074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.499203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.499285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.499418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79406) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 17:10:08.516551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.516692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.516781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 10 17:10:08.516859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 10 17:10:08.517082 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.517193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.517276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 10 17:10:08.517398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 10 17:10:08.517533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.517668 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.517791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.517926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.518046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.518205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.518328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.518460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.529425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.529608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.529690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.529882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.529967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.530166 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.530446 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.534284 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.538589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.542430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.542711 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.542992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.543292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.543590 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.543769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.543852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.544110 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.544376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.544646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.544913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.545186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.547838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.548185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.548527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.548866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.549206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.549524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.549850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.550200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.550532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.550863 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.551187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.575380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.577825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.578067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.585281 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.585554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.585982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.590284 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.591977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.592320 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.597419 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.597610 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.597747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.598009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.598493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.602193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.603035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.603326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.603603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.603889 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.604158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.604423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.604685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.606871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.607216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.611689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.612043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.612391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.612737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.613076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.613412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.613744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.614075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.623223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.623500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.628022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.631595 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.631898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.632638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.632977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.636984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.637528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.640604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.641214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.641571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.644177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.644474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.644756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.645036 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.645328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.645618 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.647063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.651170 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.654768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.655131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.655476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.655823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.656166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.656508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.665566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.665862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.666144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.666410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.674403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.676103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.676377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.676595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.676948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.677279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.677604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.679526 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.679811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.680091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.680400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.680693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.685681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.687429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.687771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.690944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.691297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.691641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.691985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.692333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.693702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.693981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.694284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.694561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.694839 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.695208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.695504 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.705873 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.706238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.706583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.706935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.707276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.708932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.709288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.713641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.717022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.720329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.723198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.724796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.725083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.725369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.728700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.732027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.733177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.734795 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.735488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.738012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.738328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.838769 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.839028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.839757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.841485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.841836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.842209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.848210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.848500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.848781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.849612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.851279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.854731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.855086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.855434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.855775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.856619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79406) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.857057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.857341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.857616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.857887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.858181 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.858464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.858746 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.859026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.859297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.859571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.859830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.860098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.860356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79406) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.865762 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.866129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.866479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.874254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 17:10:08.874599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.875039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.875378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.875714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.876059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.876397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.876734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.877074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.877409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.877742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.878076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.878421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.878743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 17:10:08.898050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ca879d9c0 pid: 79406 (default app) Mar 10 17:10:08.902044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a153c5-5268-4299-97ec-2e171f20b38c None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:08.902375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a153c5-5268-4299-97ec-2e171f20b38c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:08.902656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a153c5-5268-4299-97ec-2e171f20b38c None None] PATH_INFO: `/v3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:08.909171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Mar 10 17:10:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:08.917080 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ca879d9c0 pid: 79405 (default app) Mar 10 17:10:17.171867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d11a-fa25-444a-b71b-edca83403cc0 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:17.172429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d11a-fa25-444a-b71b-edca83403cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:17.172429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d11a-fa25-444a-b71b-edca83403cc0 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:17.174758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:10:17.182367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:17.182794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:17.182981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:17.212938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG oslo_db.sqlalchemy.engines [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 10 17:10:17.396856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG passlib.handlers.bcrypt [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79405) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 10 17:10:17.397271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG passlib.handlers.bcrypt [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79405) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 10 17:10:17.453437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:17.454996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:17.576344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 10 17:10:17.760024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d11a-fa25-444a-b71b-edca83403cc0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:17.792740 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG oslo_db.sqlalchemy.engines [None req-51b7d11a-fa25-444a-b71b-edca83403cc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 10 17:10:17.928699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d11a-fa25-444a-b71b-edca83403cc0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:17.936691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d340-3cea-4311-b89d-24d5123d5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:17.937376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d340-3cea-4311-b89d-24d5123d5552 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:17.937667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d340-3cea-4311-b89d-24d5123d5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:17.937949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d340-3cea-4311-b89d-24d5123d5552 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:17.947032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d340-3cea-4311-b89d-24d5123d5552 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:17.998027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.common.rbac_enforcer.enforcer [None req-73a6d340-3cea-4311-b89d-24d5123d5552 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 10 17:10:17.998394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d340-3cea-4311-b89d-24d5123d5552 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:18.007748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Mar 10 17:10:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 10 17:10:18.014475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:18.028859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9d16b-cd6c-4937-826e-6aa512ab1e7f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:18.033228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360d73f-15f2-4e59-812f-c73a6cece7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:18.034376 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360d73f-15f2-4e59-812f-c73a6cece7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:18.034666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360d73f-15f2-4e59-812f-c73a6cece7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:18.034943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360d73f-15f2-4e59-812f-c73a6cece7aa admin admin] PATH_INFO: `/v3/projects/6b6da1569d25429788d1024be5510eba` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:18.036549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360d73f-15f2-4e59-812f-c73a6cece7aa admin admin] RBAC: Authorizing `identity:get_project(project_id=6b6da1569d25429788d1024be5510eba)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:18.088103 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1360d73f-15f2-4e59-812f-c73a6cece7aa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 10 17:10:18.088454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360d73f-15f2-4e59-812f-c73a6cece7aa admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:18.092954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 2/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Mar 10 17:10:18 2022] GET /identity/v3/projects/6b6da1569d25429788d1024be5510eba => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:20.347640 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceaaec-1b96-465a-aaa3-2ad34c8f200a None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:20.348143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceaaec-1b96-465a-aaa3-2ad34c8f200a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:20.348229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceaaec-1b96-465a-aaa3-2ad34c8f200a None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:20.352705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 4/6] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:20.358085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a647-5a7f-42e8-8f5f-5065768e7e91 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:20.358494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a647-5a7f-42e8-8f5f-5065768e7e91 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:20.358660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a647-5a7f-42e8-8f5f-5065768e7e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:20.377229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1292a647-5a7f-42e8-8f5f-5065768e7e91 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:20.378753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1292a647-5a7f-42e8-8f5f-5065768e7e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:20.386949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 10 17:10:20.408667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceaaec-1b96-465a-aaa3-2ad34c8f200a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:20.420582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceaaec-1b96-465a-aaa3-2ad34c8f200a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:20.424985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756fc9-921e-43e2-9ce7-4293fa6c8b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:20.425607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756fc9-921e-43e2-9ce7-4293fa6c8b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:20.425892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756fc9-921e-43e2-9ce7-4293fa6c8b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:20.426200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756fc9-921e-43e2-9ce7-4293fa6c8b0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:20.434151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756fc9-921e-43e2-9ce7-4293fa6c8b0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:20.435905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756fc9-921e-43e2-9ce7-4293fa6c8b0c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:20.444409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Mar 10 17:10:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:10:20.450292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a647-5a7f-42e8-8f5f-5065768e7e91 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:20.458932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a647-5a7f-42e8-8f5f-5065768e7e91 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:20.463303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bf96d-c929-4fa6-83b8-6964ff8fe545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:20.464151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bf96d-c929-4fa6-83b8-6964ff8fe545 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:20.464435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bf96d-c929-4fa6-83b8-6964ff8fe545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:20.464713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bf96d-c929-4fa6-83b8-6964ff8fe545 admin admin] PATH_INFO: `/v3/users/fd873144a6ac489d9c499e77ba96e536` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:20.466074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bf96d-c929-4fa6-83b8-6964ff8fe545 admin admin] RBAC: Authorizing `identity:get_user(user_id=fd873144a6ac489d9c499e77ba96e536)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:20.467901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bf96d-c929-4fa6-83b8-6964ff8fe545 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:20.469419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 4/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Mar 10 17:10:20 2022] GET /identity/v3/users/fd873144a6ac489d9c499e77ba96e536 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:22.809536 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fa2d3-9d4f-49d9-b840-df30d8fdb739 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:22.810068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fa2d3-9d4f-49d9-b840-df30d8fdb739 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:22.810217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fa2d3-9d4f-49d9-b840-df30d8fdb739 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:22.811978 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:22.817157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec59645-9398-4b7b-a198-8804c36b7b92 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:22.817557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224f831-256b-45c4-ab54-550f9c721b82 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:22.817644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec59645-9398-4b7b-a198-8804c36b7b92 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:22.817728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224f831-256b-45c4-ab54-550f9c721b82 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:22.817810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec59645-9398-4b7b-a198-8804c36b7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:22.817887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224f831-256b-45c4-ab54-550f9c721b82 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:22.819475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 7/11] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:10:22.824441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bb8f7-25a1-4a61-a107-0c7a81c8b20c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:22.824731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bb8f7-25a1-4a61-a107-0c7a81c8b20c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:22.825008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bb8f7-25a1-4a61-a107-0c7a81c8b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:22.834262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1ec59645-9398-4b7b-a198-8804c36b7b92 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:22.835421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1ec59645-9398-4b7b-a198-8804c36b7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:22.865589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG passlib.handlers.bcrypt [None req-359bb8f7-25a1-4a61-a107-0c7a81c8b20c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79406) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 10 17:10:22.866009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG passlib.handlers.bcrypt [None req-359bb8f7-25a1-4a61-a107-0c7a81c8b20c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79406) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 10 17:10:22.911804 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:22.912994 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-359bb8f7-25a1-4a61-a107-0c7a81c8b20c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:22.913900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-359bb8f7-25a1-4a61-a107-0c7a81c8b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:22.935940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec59645-9398-4b7b-a198-8804c36b7b92 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:23.012265 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:10:23.034353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec59645-9398-4b7b-a198-8804c36b7b92 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:23.034779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bb8f7-25a1-4a61-a107-0c7a81c8b20c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:23.066263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b33f-d553-460d-8a48-1b1b666105b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:23.066996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b33f-d553-460d-8a48-1b1b666105b4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:23.067275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b33f-d553-460d-8a48-1b1b666105b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:23.067552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b33f-d553-460d-8a48-1b1b666105b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:23.078777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731b33f-d553-460d-8a48-1b1b666105b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:23.085632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-9731b33f-d553-460d-8a48-1b1b666105b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:10:23.087392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 6/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:10:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:10:23.093016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b33f-d553-460d-8a48-1b1b666105b4 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:23.127949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bb8f7-25a1-4a61-a107-0c7a81c8b20c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:23.159695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f74d4-5f1a-4ff0-b1b4-867f1e0fb0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:23.160576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f74d4-5f1a-4ff0-b1b4-867f1e0fb0d6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:23.160860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f74d4-5f1a-4ff0-b1b4-867f1e0fb0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:23.161134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f74d4-5f1a-4ff0-b1b4-867f1e0fb0d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:23.184843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b33f-d553-460d-8a48-1b1b666105b4 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:23.218009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c5985-be0c-4bd4-8b3e-c3afe7289d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:23.218757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5985-be0c-4bd4-8b3e-c3afe7289d21 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:23.219045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5985-be0c-4bd4-8b3e-c3afe7289d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:23.219334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5985-be0c-4bd4-8b3e-c3afe7289d21 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:23.220069 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c5985-be0c-4bd4-8b3e-c3afe7289d21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:23.220372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c5985-be0c-4bd4-8b3e-c3afe7289d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:23.221742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c5985-be0c-4bd4-8b3e-c3afe7289d21 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:23.225565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f74d4-5f1a-4ff0-b1b4-867f1e0fb0d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:23.227109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f74d4-5f1a-4ff0-b1b4-867f1e0fb0d6 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:23.232638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 7/15] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:23.238039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c5985-be0c-4bd4-8b3e-c3afe7289d21 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:23.324459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 10 17:10:23.330023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f74d4-5f1a-4ff0-b1b4-867f1e0fb0d6 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:23.335872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c5985-be0c-4bd4-8b3e-c3afe7289d21 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:23.368590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0cb43-dba5-4e1f-8674-b5791c716f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:23.369464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0cb43-dba5-4e1f-8674-b5791c716f09 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:23.369746 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0cb43-dba5-4e1f-8674-b5791c716f09 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:23.370023 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0cb43-dba5-4e1f-8674-b5791c716f09 None admin] PATH_INFO: `/v3/users/fd873144a6ac489d9c499e77ba96e536` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:23.371256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0cb43-dba5-4e1f-8674-b5791c716f09 None admin] RBAC: Authorizing `identity:get_user(user_id=fd873144a6ac489d9c499e77ba96e536)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:23.372723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0cb43-dba5-4e1f-8674-b5791c716f09 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:23.374349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 8/17] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:23 2022] GET /identity/v3/users/fd873144a6ac489d9c499e77ba96e536 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:23.379729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0cb43-dba5-4e1f-8674-b5791c716f09 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:23.421937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f74d4-5f1a-4ff0-b1b4-867f1e0fb0d6 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:23.454328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ee8ea-d800-40c1-8c68-2992501a820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:23.455114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ee8ea-d800-40c1-8c68-2992501a820f None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:23.455397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ee8ea-d800-40c1-8c68-2992501a820f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:23.455670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ee8ea-d800-40c1-8c68-2992501a820f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:23.472870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0cb43-dba5-4e1f-8674-b5791c716f09 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:23.473207 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ee8ea-d800-40c1-8c68-2992501a820f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:23.474700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ee8ea-d800-40c1-8c68-2992501a820f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:23.490754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-c96ee8ea-d800-40c1-8c68-2992501a820f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:10:23.491950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:10:23.498217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ee8ea-d800-40c1-8c68-2992501a820f None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:23.504698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a67b6a-1ed2-47bd-9643-b0fff48d6fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:23.505492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a67b6a-1ed2-47bd-9643-b0fff48d6fb5 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:23.505778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a67b6a-1ed2-47bd-9643-b0fff48d6fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:23.506355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a67b6a-1ed2-47bd-9643-b0fff48d6fb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:23.507538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a67b6a-1ed2-47bd-9643-b0fff48d6fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:23.509523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a67b6a-1ed2-47bd-9643-b0fff48d6fb5 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:23.511138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:23.516639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a67b6a-1ed2-47bd-9643-b0fff48d6fb5 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:23.591191 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ee8ea-d800-40c1-8c68-2992501a820f None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:23.609596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a67b6a-1ed2-47bd-9643-b0fff48d6fb5 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:23.627280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd669016-87e4-4179-bcb5-a6898f4757ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:23.627972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd669016-87e4-4179-bcb5-a6898f4757ed None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:23.628262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd669016-87e4-4179-bcb5-a6898f4757ed None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:23.628542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd669016-87e4-4179-bcb5-a6898f4757ed None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:23.629293 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd669016-87e4-4179-bcb5-a6898f4757ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:23.629571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd669016-87e4-4179-bcb5-a6898f4757ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:23.631000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd669016-87e4-4179-bcb5-a6898f4757ed None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:23.644484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4217931-6955-46af-a039-12be1ca0526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:23.645142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4217931-6955-46af-a039-12be1ca0526b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:23.645426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4217931-6955-46af-a039-12be1ca0526b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:23.645704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4217931-6955-46af-a039-12be1ca0526b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:23.646571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4217931-6955-46af-a039-12be1ca0526b None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.domain.id=default, user.id=fd873144a6ac489d9c499e77ba96e536) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:23.646879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4217931-6955-46af-a039-12be1ca0526b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:23.648315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4217931-6955-46af-a039-12be1ca0526b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:23.648787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:23.655088 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Mar 10 17:10:23 2022] GET /identity/v3/role_assignments?user.id=fd873144a6ac489d9c499e77ba96e536&scope.domain.id=default&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 233 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:26.315956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd4019-270c-48c8-8c8e-b00382dc4053 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:26.316934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd4019-270c-48c8-8c8e-b00382dc4053 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:26.317414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd4019-270c-48c8-8c8e-b00382dc4053 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:26.319694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:26.325563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e6746-a12f-43a4-adbf-b5b103e2a60a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:26.326445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e6746-a12f-43a4-adbf-b5b103e2a60a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:26.326931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e6746-a12f-43a4-adbf-b5b103e2a60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:26.355165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-396e6746-a12f-43a4-adbf-b5b103e2a60a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:26.356716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-396e6746-a12f-43a4-adbf-b5b103e2a60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:26.444428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:26.478865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd4019-270c-48c8-8c8e-b00382dc4053 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:26.587913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd4019-270c-48c8-8c8e-b00382dc4053 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:26.633675 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73de66-76d0-4db5-91ee-9750a99675ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:26.634862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73de66-76d0-4db5-91ee-9750a99675ed None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:26.635376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73de66-76d0-4db5-91ee-9750a99675ed None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:26.635848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73de66-76d0-4db5-91ee-9750a99675ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:26.651555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73de66-76d0-4db5-91ee-9750a99675ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:26.658799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-0e73de66-76d0-4db5-91ee-9750a99675ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:10:26.660573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 13/24] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:26.666435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e6746-a12f-43a4-adbf-b5b103e2a60a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:26.725853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132bec4-9651-425c-bbbd-a96385b52f6c None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:26.726524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132bec4-9651-425c-bbbd-a96385b52f6c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:26.727593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132bec4-9651-425c-bbbd-a96385b52f6c None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:26.730021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 14/25] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:10:26.735228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf30a1-f526-428e-91f0-113d50cf2938 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:26.735788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf30a1-f526-428e-91f0-113d50cf2938 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:26.736273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf30a1-f526-428e-91f0-113d50cf2938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:26.771270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-36cf30a1-f526-428e-91f0-113d50cf2938 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:26.772842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-36cf30a1-f526-428e-91f0-113d50cf2938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:26.781237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e6746-a12f-43a4-adbf-b5b103e2a60a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:26.825446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2f0e7-b755-4beb-901b-89350abb6d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:26.826411 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2f0e7-b755-4beb-901b-89350abb6d14 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:26.826862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2f0e7-b755-4beb-901b-89350abb6d14 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:26.827282 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2f0e7-b755-4beb-901b-89350abb6d14 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:26.828231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2f0e7-b755-4beb-901b-89350abb6d14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:26.828686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2f0e7-b755-4beb-901b-89350abb6d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:26.830318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2f0e7-b755-4beb-901b-89350abb6d14 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:26.841334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 12/26] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:26.843344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f5a40-8672-43f8-a4bd-d237026f2614 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:26.843802 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f5a40-8672-43f8-a4bd-d237026f2614 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:26.844222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f5a40-8672-43f8-a4bd-d237026f2614 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:26.847061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:26.851010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f5a40-8672-43f8-a4bd-d237026f2614 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:26.892662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:26.894476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38957c-e2fd-4cb5-af87-8051e19f4b74 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:26.894945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38957c-e2fd-4cb5-af87-8051e19f4b74 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:26.895371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38957c-e2fd-4cb5-af87-8051e19f4b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:26.924338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9e38957c-e2fd-4cb5-af87-8051e19f4b74 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:26.927151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9e38957c-e2fd-4cb5-af87-8051e19f4b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:27.034607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f5a40-8672-43f8-a4bd-d237026f2614 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:27.071229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88dd00-c73a-4537-b29d-19be32536da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:27.072104 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88dd00-c73a-4537-b29d-19be32536da3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.072381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88dd00-c73a-4537-b29d-19be32536da3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.072651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88dd00-c73a-4537-b29d-19be32536da3 None admin] PATH_INFO: `/v3/users/fd873144a6ac489d9c499e77ba96e536` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:27.075862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88dd00-c73a-4537-b29d-19be32536da3 None admin] RBAC: Authorizing `identity:get_user(user_id=fd873144a6ac489d9c499e77ba96e536)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:27.077334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88dd00-c73a-4537-b29d-19be32536da3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:27.080540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:27.081394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38957c-e2fd-4cb5-af87-8051e19f4b74 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:27.083944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 14/30] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:26 2022] GET /identity/v3/users/fd873144a6ac489d9c499e77ba96e536 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:27.085608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88dd00-c73a-4537-b29d-19be32536da3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:27.188809 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88dd00-c73a-4537-b29d-19be32536da3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:27.229314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8e8ab-b559-4629-9087-afeaef7b1fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:27.231893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8e8ab-b559-4629-9087-afeaef7b1fc2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.232341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8e8ab-b559-4629-9087-afeaef7b1fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.233928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8e8ab-b559-4629-9087-afeaef7b1fc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:27.235359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8e8ab-b559-4629-9087-afeaef7b1fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:27.237588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8e8ab-b559-4629-9087-afeaef7b1fc2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:27.241950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 15/31] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:27.243431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8e8ab-b559-4629-9087-afeaef7b1fc2 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:27.271532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38957c-e2fd-4cb5-af87-8051e19f4b74 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:27.320738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed907eb7-cf7b-4c5f-9edc-7a35fdef293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:27.322721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed907eb7-cf7b-4c5f-9edc-7a35fdef293a None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.323131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed907eb7-cf7b-4c5f-9edc-7a35fdef293a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.323569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed907eb7-cf7b-4c5f-9edc-7a35fdef293a None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:27.324450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed907eb7-cf7b-4c5f-9edc-7a35fdef293a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:27.326034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed907eb7-cf7b-4c5f-9edc-7a35fdef293a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:27.363493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8e8ab-b559-4629-9087-afeaef7b1fc2 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:27.398900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12519a2c-7938-4bb0-9e17-7ba6a7063a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:27.399630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12519a2c-7938-4bb0-9e17-7ba6a7063a11 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.399923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12519a2c-7938-4bb0-9e17-7ba6a7063a11 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.400208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12519a2c-7938-4bb0-9e17-7ba6a7063a11 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:27.400964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12519a2c-7938-4bb0-9e17-7ba6a7063a11 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:27.402398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12519a2c-7938-4bb0-9e17-7ba6a7063a11 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:27.454632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 17/32] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Mar 10 17:10:27 2022] POST /identity/v3/roles => generated 219 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:27.455969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed907eb7-cf7b-4c5f-9edc-7a35fdef293a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:27.529666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 16/33] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Mar 10 17:10:27 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:27.537155 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367569dd-c4f2-4a9c-82be-b2db8028787b None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.537883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367569dd-c4f2-4a9c-82be-b2db8028787b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.538367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367569dd-c4f2-4a9c-82be-b2db8028787b None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:27.541830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 17/34] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:27.560432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd6813-519d-4f6d-b985-d811357d05ba None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.560946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd6813-519d-4f6d-b985-d811357d05ba None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.561394 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd6813-519d-4f6d-b985-d811357d05ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:27.571957 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed907eb7-cf7b-4c5f-9edc-7a35fdef293a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:27.594767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-22cd6813-519d-4f6d-b985-d811357d05ba None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:27.596813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-22cd6813-519d-4f6d-b985-d811357d05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:27.626369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2ede-73b3-441d-9fea-8fe85dd832b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:27.627285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2ede-73b3-441d-9fea-8fe85dd832b8 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.627587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2ede-73b3-441d-9fea-8fe85dd832b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.627866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2ede-73b3-441d-9fea-8fe85dd832b8 None admin] PATH_INFO: `/v3/domains/default/users/fd873144a6ac489d9c499e77ba96e536/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:27.632691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba2ede-73b3-441d-9fea-8fe85dd832b8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fd873144a6ac489d9c499e77ba96e536, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:27.636556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba2ede-73b3-441d-9fea-8fe85dd832b8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:27.678243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 18/35] 10.222.0.16 () {58 vars in 1361 bytes} [Thu Mar 10 17:10:27 2022] PUT /identity/v3/domains/default/users/fd873144a6ac489d9c499e77ba96e536/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:10:27.680354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeb8fd-4bb4-4701-8cc7-f7fa4caf5619 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.680651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeb8fd-4bb4-4701-8cc7-f7fa4caf5619 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.680941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeb8fd-4bb4-4701-8cc7-f7fa4caf5619 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:27.691673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:27.705992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe140d8-f310-4f75-bdfc-f63226269c19 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.706259 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe140d8-f310-4f75-bdfc-f63226269c19 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.706569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe140d8-f310-4f75-bdfc-f63226269c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:27.744097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9fe140d8-f310-4f75-bdfc-f63226269c19 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:27.747126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9fe140d8-f310-4f75-bdfc-f63226269c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:27.780231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 18/37] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:10:27.820184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd6813-519d-4f6d-b985-d811357d05ba None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:27.850178 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 20/38] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:10:27.876015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe140d8-f310-4f75-bdfc-f63226269c19 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:27.948662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd6813-519d-4f6d-b985-d811357d05ba None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:27.988717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe140d8-f310-4f75-bdfc-f63226269c19 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:27.989616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9b18c-aeb8-4a8b-b4dc-b2cf344edd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:27.990454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9b18c-aeb8-4a8b-b4dc-b2cf344edd7d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:27.990738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9b18c-aeb8-4a8b-b4dc-b2cf344edd7d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:27.991012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9b18c-aeb8-4a8b-b4dc-b2cf344edd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:28.002076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9b18c-aeb8-4a8b-b4dc-b2cf344edd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:28.003720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9b18c-aeb8-4a8b-b4dc-b2cf344edd7d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:28.021291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-75b9b18c-aeb8-4a8b-b4dc-b2cf344edd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:10:28.022942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 19/39] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:28.031156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9b18c-aeb8-4a8b-b4dc-b2cf344edd7d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:28.035346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7986a70-ea83-4c12-b2d1-a16adec78d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:28.036228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7986a70-ea83-4c12-b2d1-a16adec78d1c None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:28.036661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7986a70-ea83-4c12-b2d1-a16adec78d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:28.037084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7986a70-ea83-4c12-b2d1-a16adec78d1c None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:28.037988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7986a70-ea83-4c12-b2d1-a16adec78d1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:28.040145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7986a70-ea83-4c12-b2d1-a16adec78d1c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:28.055673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Mar 10 17:10:27 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:10:28.155815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9b18c-aeb8-4a8b-b4dc-b2cf344edd7d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:28.196722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c2e4e-5973-495b-9d9e-64e291bb1876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:28.197788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c2e4e-5973-495b-9d9e-64e291bb1876 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:28.198316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c2e4e-5973-495b-9d9e-64e291bb1876 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:28.198949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c2e4e-5973-495b-9d9e-64e291bb1876 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:28.199877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c2e4e-5973-495b-9d9e-64e291bb1876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:28.200378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c2e4e-5973-495b-9d9e-64e291bb1876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:28.201983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c2e4e-5973-495b-9d9e-64e291bb1876 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:28.223224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 20/41] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:28.229842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7986a70-ea83-4c12-b2d1-a16adec78d1c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:28.279057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cf9f6-bb6c-409f-8f90-42cbfbc6a95a None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:28.279324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cf9f6-bb6c-409f-8f90-42cbfbc6a95a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:28.279559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cf9f6-bb6c-409f-8f90-42cbfbc6a95a None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:28.281359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 21/42] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:10:28.290079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0fd49-624f-4650-ad4f-51ac86136cc9 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:28.290524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0fd49-624f-4650-ad4f-51ac86136cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:28.290913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0fd49-624f-4650-ad4f-51ac86136cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:28.315412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d7e0fd49-624f-4650-ad4f-51ac86136cc9 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:28.317073 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d7e0fd49-624f-4650-ad4f-51ac86136cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:28.347337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7986a70-ea83-4c12-b2d1-a16adec78d1c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:28.381621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40350c7c-9e0f-4a3e-9fbf-2f31319e150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:28.382326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40350c7c-9e0f-4a3e-9fbf-2f31319e150d None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:28.382616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40350c7c-9e0f-4a3e-9fbf-2f31319e150d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:28.382897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40350c7c-9e0f-4a3e-9fbf-2f31319e150d None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:28.384143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40350c7c-9e0f-4a3e-9fbf-2f31319e150d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:28.385595 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40350c7c-9e0f-4a3e-9fbf-2f31319e150d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:28.389820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:28.413005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0fd49-624f-4650-ad4f-51ac86136cc9 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:28.416434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:10:28 2022] POST /identity/v3/projects => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:28.518835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0fd49-624f-4650-ad4f-51ac86136cc9 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:28.553868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956ef45-2958-435b-8e87-4fbbe599c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:28.554647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956ef45-2958-435b-8e87-4fbbe599c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:28.555089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956ef45-2958-435b-8e87-4fbbe599c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:28.555389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956ef45-2958-435b-8e87-4fbbe599c1f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:28.556855 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956ef45-2958-435b-8e87-4fbbe599c1f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:28.558369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956ef45-2958-435b-8e87-4fbbe599c1f3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:28.560212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:28.565700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40350c7c-9e0f-4a3e-9fbf-2f31319e150d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:28.666228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40350c7c-9e0f-4a3e-9fbf-2f31319e150d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:28.703239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22316b42-71b7-467e-929c-e05adcf0ab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:28.703917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316b42-71b7-467e-929c-e05adcf0ab68 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:28.704206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316b42-71b7-467e-929c-e05adcf0ab68 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:28.704489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316b42-71b7-467e-929c-e05adcf0ab68 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:28.705558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22316b42-71b7-467e-929c-e05adcf0ab68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:28.707050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22316b42-71b7-467e-929c-e05adcf0ab68 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:28.731220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:10:28 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:10:30.134598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cb0e1-ef1b-464f-a561-b0dc42b23c52 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:30.135110 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cb0e1-ef1b-464f-a561-b0dc42b23c52 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:30.135216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cb0e1-ef1b-464f-a561-b0dc42b23c52 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:30.137068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:30.142039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49692bee-f1c0-40b8-857d-9643ada35126 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:30.142469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49692bee-f1c0-40b8-857d-9643ada35126 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:30.142628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49692bee-f1c0-40b8-857d-9643ada35126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:30.159461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-49692bee-f1c0-40b8-857d-9643ada35126 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:30.160642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-49692bee-f1c0-40b8-857d-9643ada35126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:30.223316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:10:30.246604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cb0e1-ef1b-464f-a561-b0dc42b23c52 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:30.345464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cb0e1-ef1b-464f-a561-b0dc42b23c52 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:30.379927 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a660c9-8b62-41dc-9da9-f46f93670335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:30.380728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a660c9-8b62-41dc-9da9-f46f93670335 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:30.381015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a660c9-8b62-41dc-9da9-f46f93670335 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:30.381311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a660c9-8b62-41dc-9da9-f46f93670335 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:30.391192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a660c9-8b62-41dc-9da9-f46f93670335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:30.397885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-b0a660c9-8b62-41dc-9da9-f46f93670335 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:10:30.399654 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:10:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:30.405555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49692bee-f1c0-40b8-857d-9643ada35126 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:30.499774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49692bee-f1c0-40b8-857d-9643ada35126 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:30.532502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ccc33-27b4-4ef5-a607-8e1d1a4dbdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:30.533182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ccc33-27b4-4ef5-a607-8e1d1a4dbdb3 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:30.533473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ccc33-27b4-4ef5-a607-8e1d1a4dbdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:30.533757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ccc33-27b4-4ef5-a607-8e1d1a4dbdb3 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:30.534543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ccc33-27b4-4ef5-a607-8e1d1a4dbdb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:30.534856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ccc33-27b4-4ef5-a607-8e1d1a4dbdb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:30.536248 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ccc33-27b4-4ef5-a607-8e1d1a4dbdb3 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:30.547642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:30.553144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a660c9-8b62-41dc-9da9-f46f93670335 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:30.659322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a660c9-8b62-41dc-9da9-f46f93670335 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:30.693826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1223ac-58ed-4fff-b1da-399f863e0552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:30.694757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1223ac-58ed-4fff-b1da-399f863e0552 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:30.695046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1223ac-58ed-4fff-b1da-399f863e0552 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:30.695328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1223ac-58ed-4fff-b1da-399f863e0552 None admin] PATH_INFO: `/v3/users/fd873144a6ac489d9c499e77ba96e536` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:30.697120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1223ac-58ed-4fff-b1da-399f863e0552 None admin] RBAC: Authorizing `identity:get_user(user_id=fd873144a6ac489d9c499e77ba96e536)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:30.698652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1223ac-58ed-4fff-b1da-399f863e0552 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:30.700344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 26/51] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:30 2022] GET /identity/v3/users/fd873144a6ac489d9c499e77ba96e536 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:30.706213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ccc33-27b4-4ef5-a607-8e1d1a4dbdb3 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:30.804287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ccc33-27b4-4ef5-a607-8e1d1a4dbdb3 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:30.836783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39933eb3-90aa-4b5c-b2de-9a4466fc9572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:30.837581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39933eb3-90aa-4b5c-b2de-9a4466fc9572 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:30.837864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39933eb3-90aa-4b5c-b2de-9a4466fc9572 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:30.838170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39933eb3-90aa-4b5c-b2de-9a4466fc9572 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:30.839323 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39933eb3-90aa-4b5c-b2de-9a4466fc9572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:30.840768 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39933eb3-90aa-4b5c-b2de-9a4466fc9572 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:30.842400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 26/52] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:30.848035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1223ac-58ed-4fff-b1da-399f863e0552 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:30.941416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1223ac-58ed-4fff-b1da-399f863e0552 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:30.972583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f952120-9898-43f9-ba9f-622ef978c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:30.973238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f952120-9898-43f9-ba9f-622ef978c4ab None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:30.973527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f952120-9898-43f9-ba9f-622ef978c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:30.973809 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f952120-9898-43f9-ba9f-622ef978c4ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:30.974682 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f952120-9898-43f9-ba9f-622ef978c4ab None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.domain.id=default, user.id=fd873144a6ac489d9c499e77ba96e536) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:30.975005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f952120-9898-43f9-ba9f-622ef978c4ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:30.976457 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f952120-9898-43f9-ba9f-622ef978c4ab None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:30.982239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Mar 10 17:10:30 2022] GET /identity/v3/role_assignments?user.id=fd873144a6ac489d9c499e77ba96e536&scope.domain.id=default&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 530 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:31.051350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a1d91-c889-488b-b79f-e0fa3bf3846e None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:31.051699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a1d91-c889-488b-b79f-e0fa3bf3846e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:31.051994 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a1d91-c889-488b-b79f-e0fa3bf3846e None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:31.053791 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 27/54] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:31.060057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dcd25-9421-4a67-8b26-b8db1db3a7bb None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:31.060439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dcd25-9421-4a67-8b26-b8db1db3a7bb None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:31.060785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dcd25-9421-4a67-8b26-b8db1db3a7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:31.078513 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e79dcd25-9421-4a67-8b26-b8db1db3a7bb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:31.079724 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e79dcd25-9421-4a67-8b26-b8db1db3a7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:31.147570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 28/55] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:31.170316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a1d91-c889-488b-b79f-e0fa3bf3846e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:31.269374 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a1d91-c889-488b-b79f-e0fa3bf3846e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:31.302158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f4fc8-81c2-44ea-8f75-64d3dfcc37cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:31.302966 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4fc8-81c2-44ea-8f75-64d3dfcc37cc None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:31.303253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4fc8-81c2-44ea-8f75-64d3dfcc37cc None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:31.303533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4fc8-81c2-44ea-8f75-64d3dfcc37cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:31.304720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f4fc8-81c2-44ea-8f75-64d3dfcc37cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:31.306831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f4fc8-81c2-44ea-8f75-64d3dfcc37cc None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:31.308356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:31.313879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dcd25-9421-4a67-8b26-b8db1db3a7bb None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:31.404489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dcd25-9421-4a67-8b26-b8db1db3a7bb None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:31.436334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341dda6-306e-4a73-b34d-090a597c4c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:31.436975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341dda6-306e-4a73-b34d-090a597c4c97 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:31.437257 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341dda6-306e-4a73-b34d-090a597c4c97 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:31.437531 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341dda6-306e-4a73-b34d-090a597c4c97 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:31.438259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341dda6-306e-4a73-b34d-090a597c4c97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:31.439675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341dda6-306e-4a73-b34d-090a597c4c97 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:31.464032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Mar 10 17:10:31 2022] POST /identity/v3/projects => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:33.739695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255df7b-1efb-49d9-aeeb-a10faac04d21 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:33.740188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255df7b-1efb-49d9-aeeb-a10faac04d21 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:33.740270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255df7b-1efb-49d9-aeeb-a10faac04d21 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:33.742010 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:33.747210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec566e5-f25d-4a23-93a5-e45ee7b59679 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:33.747569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec566e5-f25d-4a23-93a5-e45ee7b59679 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:33.747775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec566e5-f25d-4a23-93a5-e45ee7b59679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:33.764424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-dec566e5-f25d-4a23-93a5-e45ee7b59679 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:33.765586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-dec566e5-f25d-4a23-93a5-e45ee7b59679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:33.827001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:33.851542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255df7b-1efb-49d9-aeeb-a10faac04d21 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:33.945335 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255df7b-1efb-49d9-aeeb-a10faac04d21 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:33.976592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8b8d6-eaba-465e-a53e-dda305b5da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:33.977401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8b8d6-eaba-465e-a53e-dda305b5da43 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:33.977688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8b8d6-eaba-465e-a53e-dda305b5da43 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:33.977971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8b8d6-eaba-465e-a53e-dda305b5da43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:33.979164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8b8d6-eaba-465e-a53e-dda305b5da43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:33.980605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8b8d6-eaba-465e-a53e-dda305b5da43 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:33.982178 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:33.987538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec566e5-f25d-4a23-93a5-e45ee7b59679 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:34.079618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec566e5-f25d-4a23-93a5-e45ee7b59679 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:34.109945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaadce-8717-46ba-adee-1d624817b02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:34.110620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaadce-8717-46ba-adee-1d624817b02e None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:34.110904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaadce-8717-46ba-adee-1d624817b02e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:34.111182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaadce-8717-46ba-adee-1d624817b02e None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:34.111887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaadce-8717-46ba-adee-1d624817b02e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:34.113313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaadce-8717-46ba-adee-1d624817b02e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:34.137612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:10:33 2022] POST /identity/v3/users => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:37.635086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9b756-806c-4cc7-a9e0-64e64479469c None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:37.635086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9b756-806c-4cc7-a9e0-64e64479469c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:37.635086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9b756-806c-4cc7-a9e0-64e64479469c None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:37.635086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:37.641013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b44acb-6165-4ea6-8e64-3b5b2175fe19 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:37.641502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b44acb-6165-4ea6-8e64-3b5b2175fe19 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:37.641703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b44acb-6165-4ea6-8e64-3b5b2175fe19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:37.663472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-30b44acb-6165-4ea6-8e64-3b5b2175fe19 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:37.665224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-30b44acb-6165-4ea6-8e64-3b5b2175fe19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:37.751025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:37.778137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472030-a858-4c70-b2e4-6f42b1b81f28 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:37.778137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472030-a858-4c70-b2e4-6f42b1b81f28 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:37.778137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472030-a858-4c70-b2e4-6f42b1b81f28 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:37.779357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 32/64] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:37.784332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b44acb-6165-4ea6-8e64-3b5b2175fe19 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:37.786692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbea7bd-8c94-44e2-8b14-1e07500eb514 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:37.786692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbea7bd-8c94-44e2-8b14-1e07500eb514 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:37.786692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbea7bd-8c94-44e2-8b14-1e07500eb514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:37.803352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ddbea7bd-8c94-44e2-8b14-1e07500eb514 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:37.804897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ddbea7bd-8c94-44e2-8b14-1e07500eb514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:37.875163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:37.937901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b44acb-6165-4ea6-8e64-3b5b2175fe19 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:37.940910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbea7bd-8c94-44e2-8b14-1e07500eb514 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:37.972716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8386a-add7-4499-a236-cee88fa8844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:37.973358 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8386a-add7-4499-a236-cee88fa8844b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:37.973646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8386a-add7-4499-a236-cee88fa8844b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:37.973930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8386a-add7-4499-a236-cee88fa8844b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:37.984820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8386a-add7-4499-a236-cee88fa8844b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:37.991814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-f3f8386a-add7-4499-a236-cee88fa8844b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:10:37.993041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 33/66] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:37.994451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbb8cc-7667-4e7f-906e-50daa49c947e None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:37.994877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbb8cc-7667-4e7f-906e-50daa49c947e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:37.995285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbb8cc-7667-4e7f-906e-50daa49c947e None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:37.997338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 34/67] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:38.005819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b0b12-fab5-4f47-8114-10f264f37eb9 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.005819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b0b12-fab5-4f47-8114-10f264f37eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.005819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b0b12-fab5-4f47-8114-10f264f37eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.022378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-602b0b12-fab5-4f47-8114-10f264f37eb9 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:38.024357 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-602b0b12-fab5-4f47-8114-10f264f37eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:38.062586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbea7bd-8c94-44e2-8b14-1e07500eb514 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.095768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 35/68] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:38.096784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b0b12-fab5-4f47-8114-10f264f37eb9 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.107670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a6c0b-eb80-498b-8fc5-09c3f148b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.109006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6c0b-eb80-498b-8fc5-09c3f148b6af None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.109535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6c0b-eb80-498b-8fc5-09c3f148b6af None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.110186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6c0b-eb80-498b-8fc5-09c3f148b6af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.122793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a6c0b-eb80-498b-8fc5-09c3f148b6af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:38.130060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-150a6c0b-eb80-498b-8fc5-09c3f148b6af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:10:38.131421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:10:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:10:38.135437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cf80d-9619-4ba9-8121-b179a07b4560 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.135724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cf80d-9619-4ba9-8121-b179a07b4560 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.136004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cf80d-9619-4ba9-8121-b179a07b4560 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.137747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 35/70] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:38.138672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cf80d-9619-4ba9-8121-b179a07b4560 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.194928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b0b12-fab5-4f47-8114-10f264f37eb9 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.228282 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acc62b-1a63-4047-975a-016ffa38bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.228954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acc62b-1a63-4047-975a-016ffa38bef6 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.229243 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acc62b-1a63-4047-975a-016ffa38bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.229526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acc62b-1a63-4047-975a-016ffa38bef6 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.230309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acc62b-1a63-4047-975a-016ffa38bef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:38.230623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acc62b-1a63-4047-975a-016ffa38bef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:38.232015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acc62b-1a63-4047-975a-016ffa38bef6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:38.239381 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cf80d-9619-4ba9-8121-b179a07b4560 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.239813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:38.240592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acc62b-1a63-4047-975a-016ffa38bef6 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.274215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae06f6a-e449-4ad6-aaa7-68fec90f8001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.275020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06f6a-e449-4ad6-aaa7-68fec90f8001 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.275311 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06f6a-e449-4ad6-aaa7-68fec90f8001 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.275610 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06f6a-e449-4ad6-aaa7-68fec90f8001 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.285208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae06f6a-e449-4ad6-aaa7-68fec90f8001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:38.292260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-8ae06f6a-e449-4ad6-aaa7-68fec90f8001 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:10:38.293455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:38.294937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83852440-2335-43f2-b5fc-2ab5e9da18dc None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.295230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83852440-2335-43f2-b5fc-2ab5e9da18dc None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.295514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83852440-2335-43f2-b5fc-2ab5e9da18dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.312097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-83852440-2335-43f2-b5fc-2ab5e9da18dc None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:38.313296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-83852440-2335-43f2-b5fc-2ab5e9da18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:38.336958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acc62b-1a63-4047-975a-016ffa38bef6 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.369287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01607e4a-fafe-4745-bd7a-2814a9756e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.369959 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01607e4a-fafe-4745-bd7a-2814a9756e08 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.370304 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01607e4a-fafe-4745-bd7a-2814a9756e08 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.370586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01607e4a-fafe-4745-bd7a-2814a9756e08 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.371336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01607e4a-fafe-4745-bd7a-2814a9756e08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:38.371636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01607e4a-fafe-4745-bd7a-2814a9756e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:38.373010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01607e4a-fafe-4745-bd7a-2814a9756e08 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:38.378028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 37/73] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:38.381895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457486d0-2825-4077-9e1c-61f5c9464f78 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.381895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457486d0-2825-4077-9e1c-61f5c9464f78 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.381895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457486d0-2825-4077-9e1c-61f5c9464f78 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.381895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 38/74] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:38.382368 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457486d0-2825-4077-9e1c-61f5c9464f78 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.385309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:38.386404 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01607e4a-fafe-4745-bd7a-2814a9756e08 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.485693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457486d0-2825-4077-9e1c-61f5c9464f78 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.488687 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01607e4a-fafe-4745-bd7a-2814a9756e08 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.518088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d4b9-bc29-4c04-9cfb-9da34a61ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.518990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d4b9-bc29-4c04-9cfb-9da34a61ca3b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.519278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d4b9-bc29-4c04-9cfb-9da34a61ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.519558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d4b9-bc29-4c04-9cfb-9da34a61ca3b None admin] PATH_INFO: `/v3/users/62c6a5f644564d4ea81a8a00bc3dc990` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.520775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edc72e-6122-49a2-a112-b0a29dca1fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.521441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc72e-6122-49a2-a112-b0a29dca1fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.521727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc72e-6122-49a2-a112-b0a29dca1fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.522014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc72e-6122-49a2-a112-b0a29dca1fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.522794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edc72e-6122-49a2-a112-b0a29dca1fb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:38.523108 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edc72e-6122-49a2-a112-b0a29dca1fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:38.524527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edc72e-6122-49a2-a112-b0a29dca1fb9 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:38.532269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 38/76] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:38.533435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b607b8-37f0-44b5-8d48-9ebc2611d708 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.533731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b607b8-37f0-44b5-8d48-9ebc2611d708 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.534018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b607b8-37f0-44b5-8d48-9ebc2611d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.534357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d4b9-bc29-4c04-9cfb-9da34a61ca3b None admin] RBAC: Authorizing `identity:get_user(user_id=62c6a5f644564d4ea81a8a00bc3dc990)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:38.535938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d4b9-bc29-4c04-9cfb-9da34a61ca3b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:38.537877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/users/62c6a5f644564d4ea81a8a00bc3dc990 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:38.538913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d4b9-bc29-4c04-9cfb-9da34a61ca3b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.550049 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-53b607b8-37f0-44b5-8d48-9ebc2611d708 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:38.551263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-53b607b8-37f0-44b5-8d48-9ebc2611d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:38.613333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 39/78] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:38.614164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b607b8-37f0-44b5-8d48-9ebc2611d708 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.633743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d4b9-bc29-4c04-9cfb-9da34a61ca3b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.666060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5c178-da79-4bb5-b2ec-f261f23ca646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.666961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5c178-da79-4bb5-b2ec-f261f23ca646 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.667244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5c178-da79-4bb5-b2ec-f261f23ca646 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.667515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5c178-da79-4bb5-b2ec-f261f23ca646 None admin] PATH_INFO: `/v3/users/fd873144a6ac489d9c499e77ba96e536` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.668704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5c178-da79-4bb5-b2ec-f261f23ca646 None admin] RBAC: Authorizing `identity:get_user(user_id=fd873144a6ac489d9c499e77ba96e536)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:38.670149 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5c178-da79-4bb5-b2ec-f261f23ca646 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:38.671752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/users/fd873144a6ac489d9c499e77ba96e536 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:38.672754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5c178-da79-4bb5-b2ec-f261f23ca646 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.718006 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b607b8-37f0-44b5-8d48-9ebc2611d708 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.749787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5a8db-88f6-4663-8dd7-6733f1965bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.750551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5a8db-88f6-4663-8dd7-6733f1965bbf None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.750838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5a8db-88f6-4663-8dd7-6733f1965bbf None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.751118 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5a8db-88f6-4663-8dd7-6733f1965bbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.761146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5a8db-88f6-4663-8dd7-6733f1965bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:38.768270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-72b5a8db-88f6-4663-8dd7-6733f1965bbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:10:38.769430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 40/80] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:38.770227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5a8db-88f6-4663-8dd7-6733f1965bbf None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.773442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5c178-da79-4bb5-b2ec-f261f23ca646 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.806068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddaf69-b434-48a4-b3df-e23dbc789183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.806971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddaf69-b434-48a4-b3df-e23dbc789183 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.807255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddaf69-b434-48a4-b3df-e23dbc789183 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.807532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddaf69-b434-48a4-b3df-e23dbc789183 None admin] PATH_INFO: `/v3/users/62c6a5f644564d4ea81a8a00bc3dc990` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.808754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddaf69-b434-48a4-b3df-e23dbc789183 None admin] RBAC: Authorizing `identity:get_user(user_id=62c6a5f644564d4ea81a8a00bc3dc990)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:38.810235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddaf69-b434-48a4-b3df-e23dbc789183 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:38.811850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 41/81] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/users/62c6a5f644564d4ea81a8a00bc3dc990 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:38.812602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddaf69-b434-48a4-b3df-e23dbc789183 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.867288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5a8db-88f6-4663-8dd7-6733f1965bbf None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.898257 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff11f6-d48a-4347-bb66-23569c2407e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.899438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff11f6-d48a-4347-bb66-23569c2407e7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.899724 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff11f6-d48a-4347-bb66-23569c2407e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.900000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff11f6-d48a-4347-bb66-23569c2407e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.905612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddaf69-b434-48a4-b3df-e23dbc789183 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:38.937242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506dd48-1202-442e-97fe-518f0fc494fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:38.938031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506dd48-1202-442e-97fe-518f0fc494fd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:38.938349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506dd48-1202-442e-97fe-518f0fc494fd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:38.938632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506dd48-1202-442e-97fe-518f0fc494fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:38.939813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506dd48-1202-442e-97fe-518f0fc494fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:38.941254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506dd48-1202-442e-97fe-518f0fc494fd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:38.943039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 42/82] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:38.943637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506dd48-1202-442e-97fe-518f0fc494fd None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:38.963532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff11f6-d48a-4347-bb66-23569c2407e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:38.965007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff11f6-d48a-4347-bb66-23569c2407e7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.044385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506dd48-1202-442e-97fe-518f0fc494fd None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.071490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 41/83] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:39.072335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff11f6-d48a-4347-bb66-23569c2407e7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.081657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa08ee-44a9-4a35-9ab0-be265d77f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.082350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa08ee-44a9-4a35-9ab0-be265d77f5ec None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.082645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa08ee-44a9-4a35-9ab0-be265d77f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.082935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa08ee-44a9-4a35-9ab0-be265d77f5ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:39.145456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa08ee-44a9-4a35-9ab0-be265d77f5ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:39.146960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa08ee-44a9-4a35-9ab0-be265d77f5ec None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.163200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff11f6-d48a-4347-bb66-23569c2407e7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.195320 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207e3e-c06d-4947-953e-7128f9ada59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.195980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207e3e-c06d-4947-953e-7128f9ada59a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.196267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207e3e-c06d-4947-953e-7128f9ada59a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.196549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207e3e-c06d-4947-953e-7128f9ada59a None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:39.197293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81207e3e-c06d-4947-953e-7128f9ada59a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:39.197602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81207e3e-c06d-4947-953e-7128f9ada59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:39.199011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81207e3e-c06d-4947-953e-7128f9ada59a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.206490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:10:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:39.207263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207e3e-c06d-4947-953e-7128f9ada59a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.241294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 43/85] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:39.242150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa08ee-44a9-4a35-9ab0-be265d77f5ec None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.300174 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207e3e-c06d-4947-953e-7128f9ada59a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.331707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf69cf1-6c5b-4812-b799-9bdd90e27347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.332360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf69cf1-6c5b-4812-b799-9bdd90e27347 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.332649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf69cf1-6c5b-4812-b799-9bdd90e27347 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.332931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf69cf1-6c5b-4812-b799-9bdd90e27347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:39.335348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa08ee-44a9-4a35-9ab0-be265d77f5ec None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.369805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db839e9a-7e41-4fa3-a352-9606e7c8f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.370522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db839e9a-7e41-4fa3-a352-9606e7c8f814 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.370809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db839e9a-7e41-4fa3-a352-9606e7c8f814 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.371086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db839e9a-7e41-4fa3-a352-9606e7c8f814 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:39.371797 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db839e9a-7e41-4fa3-a352-9606e7c8f814 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:39.373248 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db839e9a-7e41-4fa3-a352-9606e7c8f814 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.397710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 44/86] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:10:39 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:39.399093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db839e9a-7e41-4fa3-a352-9606e7c8f814 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.404078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf69cf1-6c5b-4812-b799-9bdd90e27347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:39.405597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf69cf1-6c5b-4812-b799-9bdd90e27347 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.511396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 43/87] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:39.512353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf69cf1-6c5b-4812-b799-9bdd90e27347 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.520316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db839e9a-7e41-4fa3-a352-9606e7c8f814 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.555419 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e851d-7582-4047-ba77-37c15fed9b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.556232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e851d-7582-4047-ba77-37c15fed9b20 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.556518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e851d-7582-4047-ba77-37c15fed9b20 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.556798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e851d-7582-4047-ba77-37c15fed9b20 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:39.558049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e851d-7582-4047-ba77-37c15fed9b20 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:39.559657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e851d-7582-4047-ba77-37c15fed9b20 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.566292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 45/88] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:39 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:39.566292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e851d-7582-4047-ba77-37c15fed9b20 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.614330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf69cf1-6c5b-4812-b799-9bdd90e27347 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.649653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc41b0-b2fa-4b36-95d1-11a5b5074f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.650584 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc41b0-b2fa-4b36-95d1-11a5b5074f16 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.650865 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc41b0-b2fa-4b36-95d1-11a5b5074f16 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.651137 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc41b0-b2fa-4b36-95d1-11a5b5074f16 None admin] PATH_INFO: `/v3/users/62c6a5f644564d4ea81a8a00bc3dc990` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:39.652513 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc41b0-b2fa-4b36-95d1-11a5b5074f16 None admin] RBAC: Authorizing `identity:get_user(user_id=62c6a5f644564d4ea81a8a00bc3dc990)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:39.654293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc41b0-b2fa-4b36-95d1-11a5b5074f16 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.655674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 44/89] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:39 2022] GET /identity/v3/users/62c6a5f644564d4ea81a8a00bc3dc990 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:39.658441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc41b0-b2fa-4b36-95d1-11a5b5074f16 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.673358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e851d-7582-4047-ba77-37c15fed9b20 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.709271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a63a4-a55d-47ed-b745-247d2e86c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.710501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a63a4-a55d-47ed-b745-247d2e86c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.711600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a63a4-a55d-47ed-b745-247d2e86c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.712086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a63a4-a55d-47ed-b745-247d2e86c9c6 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:39.713495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a63a4-a55d-47ed-b745-247d2e86c9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:39.715199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a63a4-a55d-47ed-b745-247d2e86c9c6 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.717428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:39 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:39.718557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a63a4-a55d-47ed-b745-247d2e86c9c6 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.760754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc41b0-b2fa-4b36-95d1-11a5b5074f16 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.794581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6d7f1-1eca-4bd1-9153-0a85f9956dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.795454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6d7f1-1eca-4bd1-9153-0a85f9956dd3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.795740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6d7f1-1eca-4bd1-9153-0a85f9956dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.796019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6d7f1-1eca-4bd1-9153-0a85f9956dd3 None admin] PATH_INFO: `/v3/projects/ad48d2adb0e544498efea215d45fa715` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:39.797225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6d7f1-1eca-4bd1-9153-0a85f9956dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=ad48d2adb0e544498efea215d45fa715)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:39.798968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6d7f1-1eca-4bd1-9153-0a85f9956dd3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.800808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 45/91] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:39 2022] GET /identity/v3/projects/ad48d2adb0e544498efea215d45fa715 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:39.801488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6d7f1-1eca-4bd1-9153-0a85f9956dd3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.821431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a63a4-a55d-47ed-b745-247d2e86c9c6 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.854996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785ea4-d0d3-4b64-9421-4a69c9002a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.855643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785ea4-d0d3-4b64-9421-4a69c9002a11 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.855928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785ea4-d0d3-4b64-9421-4a69c9002a11 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.856206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785ea4-d0d3-4b64-9421-4a69c9002a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:39.857032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25785ea4-d0d3-4b64-9421-4a69c9002a11 None admin] RBAC: Adding query filter params (role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=55d0918683154136b5f35d663a2df767, user.id=62c6a5f644564d4ea81a8a00bc3dc990) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:39.857346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25785ea4-d0d3-4b64-9421-4a69c9002a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:39.858830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25785ea4-d0d3-4b64-9421-4a69c9002a11 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:39.866726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 47/92] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:39 2022] GET /identity/v3/role_assignments?user.id=62c6a5f644564d4ea81a8a00bc3dc990&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=43e227d04ba64588acce441d98a394f3 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:39.868077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785ea4-d0d3-4b64-9421-4a69c9002a11 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:39.902910 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6d7f1-1eca-4bd1-9153-0a85f9956dd3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:39.939413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209e54c-dfb2-401d-9c3f-83ef89b86ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:39.940078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209e54c-dfb2-401d-9c3f-83ef89b86ffe None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:39.940364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209e54c-dfb2-401d-9c3f-83ef89b86ffe None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:39.940643 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209e54c-dfb2-401d-9c3f-83ef89b86ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:40.009837 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209e54c-dfb2-401d-9c3f-83ef89b86ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:40.011491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209e54c-dfb2-401d-9c3f-83ef89b86ffe None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:40.055468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785ea4-d0d3-4b64-9421-4a69c9002a11 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:40.125048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c331b4-d003-460e-bda8-5c75629dab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:40.125641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c331b4-d003-460e-bda8-5c75629dab78 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:40.125923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c331b4-d003-460e-bda8-5c75629dab78 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:40.126231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c331b4-d003-460e-bda8-5c75629dab78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:40.127071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c331b4-d003-460e-bda8-5c75629dab78 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=55d0918683154136b5f35d663a2df767, user.id=fd873144a6ac489d9c499e77ba96e536) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:40.127381 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c331b4-d003-460e-bda8-5c75629dab78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:40.128870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c331b4-d003-460e-bda8-5c75629dab78 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:40.133918 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 46/93] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:40.135538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 48/94] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:39 2022] GET /identity/v3/role_assignments?user.id=fd873144a6ac489d9c499e77ba96e536&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:40.139613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209e54c-dfb2-401d-9c3f-83ef89b86ffe None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:40.147761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c331b4-d003-460e-bda8-5c75629dab78 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:40.244925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209e54c-dfb2-401d-9c3f-83ef89b86ffe None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:40.281113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e3a0-4d75-4962-8055-41b89c3779bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:40.281786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e3a0-4d75-4962-8055-41b89c3779bc None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:40.282074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e3a0-4d75-4962-8055-41b89c3779bc None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:40.282383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e3a0-4d75-4962-8055-41b89c3779bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:40.283224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2e3a0-4d75-4962-8055-41b89c3779bc None admin] RBAC: Adding query filter params (role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=ad48d2adb0e544498efea215d45fa715, user.id=62c6a5f644564d4ea81a8a00bc3dc990) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:40.283537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2e3a0-4d75-4962-8055-41b89c3779bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:40.285003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2e3a0-4d75-4962-8055-41b89c3779bc None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:40.293844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 47/95] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:40 2022] GET /identity/v3/role_assignments?user.id=62c6a5f644564d4ea81a8a00bc3dc990&scope.project.id=ad48d2adb0e544498efea215d45fa715&role.id=43e227d04ba64588acce441d98a394f3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:40.302256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c331b4-d003-460e-bda8-5c75629dab78 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:40.346357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b838ff-bcf4-45cd-9b39-8779da1e63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:40.347289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b838ff-bcf4-45cd-9b39-8779da1e63f9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:40.347542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b838ff-bcf4-45cd-9b39-8779da1e63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:40.347819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b838ff-bcf4-45cd-9b39-8779da1e63f9 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:40.355198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b838ff-bcf4-45cd-9b39-8779da1e63f9 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:40.356704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b838ff-bcf4-45cd-9b39-8779da1e63f9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:40.358690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:40 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:40.365052 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e3a0-4d75-4962-8055-41b89c3779bc None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:40.486642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e3a0-4d75-4962-8055-41b89c3779bc None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:40.526446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a3b36-1af2-4c6b-a9bd-848875ab21a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:40.527138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a3b36-1af2-4c6b-a9bd-848875ab21a8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:40.527421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a3b36-1af2-4c6b-a9bd-848875ab21a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:40.527702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a3b36-1af2-4c6b-a9bd-848875ab21a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:40.528552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a3b36-1af2-4c6b-a9bd-848875ab21a8 None admin] RBAC: Adding query filter params (role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=55d0918683154136b5f35d663a2df767, user.id=62c6a5f644564d4ea81a8a00bc3dc990) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:40.528862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a3b36-1af2-4c6b-a9bd-848875ab21a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:40.530425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a3b36-1af2-4c6b-a9bd-848875ab21a8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:40.538825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:40 2022] GET /identity/v3/role_assignments?user.id=62c6a5f644564d4ea81a8a00bc3dc990&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:42.370857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a569e-d2eb-4a79-8b98-a74f614500bd None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:42.371842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a569e-d2eb-4a79-8b98-a74f614500bd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:42.372324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a569e-d2eb-4a79-8b98-a74f614500bd None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:42.374322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:42.379472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0d2f6-7d03-41f1-ace0-047eea9bfa27 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:42.380283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0d2f6-7d03-41f1-ace0-047eea9bfa27 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:42.380764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0d2f6-7d03-41f1-ace0-047eea9bfa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:42.404058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3da0d2f6-7d03-41f1-ace0-047eea9bfa27 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:42.405634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3da0d2f6-7d03-41f1-ace0-047eea9bfa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:42.494056 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 49/99] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:42.529462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a569e-d2eb-4a79-8b98-a74f614500bd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:42.655806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a569e-d2eb-4a79-8b98-a74f614500bd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:42.689782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ab9cb-1849-40b4-907b-fe7a34d4c158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:42.690967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ab9cb-1849-40b4-907b-fe7a34d4c158 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:42.691550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ab9cb-1849-40b4-907b-fe7a34d4c158 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:42.692016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ab9cb-1849-40b4-907b-fe7a34d4c158 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:42.704051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ab9cb-1849-40b4-907b-fe7a34d4c158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:42.712568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-bf3ab9cb-1849-40b4-907b-fe7a34d4c158 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 17:10:42.714429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 51/100] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:42.723226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0d2f6-7d03-41f1-ace0-047eea9bfa27 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:42.830402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0d2f6-7d03-41f1-ace0-047eea9bfa27 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:42.869762 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c312164-0bbc-4a02-a6f5-6906b273fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:42.870821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312164-0bbc-4a02-a6f5-6906b273fb7e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:42.871317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312164-0bbc-4a02-a6f5-6906b273fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:42.871803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312164-0bbc-4a02-a6f5-6906b273fb7e None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:42.872778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c312164-0bbc-4a02-a6f5-6906b273fb7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:42.873293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c312164-0bbc-4a02-a6f5-6906b273fb7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:42.874950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c312164-0bbc-4a02-a6f5-6906b273fb7e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:42.889814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 50/101] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:42.895309 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ab9cb-1849-40b4-907b-fe7a34d4c158 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:43.010123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ab9cb-1849-40b4-907b-fe7a34d4c158 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:43.049908 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d50139-bcb9-4420-a5e5-1465140db25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:43.051215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d50139-bcb9-4420-a5e5-1465140db25a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.051705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d50139-bcb9-4420-a5e5-1465140db25a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.052185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d50139-bcb9-4420-a5e5-1465140db25a None admin] PATH_INFO: `/v3/users/3304ca1661ce470dbb2749289827ff07` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.071473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d50139-bcb9-4420-a5e5-1465140db25a None admin] RBAC: Authorizing `identity:get_user(user_id=3304ca1661ce470dbb2749289827ff07)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:43.073330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d50139-bcb9-4420-a5e5-1465140db25a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:43.075450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:42 2022] GET /identity/v3/users/3304ca1661ce470dbb2749289827ff07 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:43.080931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c312164-0bbc-4a02-a6f5-6906b273fb7e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:43.124834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35790737-07a1-4a94-9591-1a21019bf924 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.125477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35790737-07a1-4a94-9591-1a21019bf924 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.125962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35790737-07a1-4a94-9591-1a21019bf924 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.128003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 53/103] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:10:43.133709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ca19c-f0a8-4739-9f70-23410f7a3042 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.134297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ca19c-f0a8-4739-9f70-23410f7a3042 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.134801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ca19c-f0a8-4739-9f70-23410f7a3042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.151943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d40ca19c-f0a8-4739-9f70-23410f7a3042 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:43.153456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d40ca19c-f0a8-4739-9f70-23410f7a3042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:43.202744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c312164-0bbc-4a02-a6f5-6906b273fb7e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:43.221554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 54/104] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:10:43.245072 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07211715-5482-4eaa-90a9-840230cf2318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:43.245738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07211715-5482-4eaa-90a9-840230cf2318 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.246024 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07211715-5482-4eaa-90a9-840230cf2318 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.246333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07211715-5482-4eaa-90a9-840230cf2318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.246632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ca19c-f0a8-4739-9f70-23410f7a3042 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:43.322145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07211715-5482-4eaa-90a9-840230cf2318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:43.323623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07211715-5482-4eaa-90a9-840230cf2318 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:43.421688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 51/105] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:43.432563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07211715-5482-4eaa-90a9-840230cf2318 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:43.457867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ca19c-f0a8-4739-9f70-23410f7a3042 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:43.527507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83aeaee-2002-4a6d-a20c-f9c0244e3d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:43.531601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aeaee-2002-4a6d-a20c-f9c0244e3d2e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.531601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aeaee-2002-4a6d-a20c-f9c0244e3d2e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.531601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aeaee-2002-4a6d-a20c-f9c0244e3d2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.531601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83aeaee-2002-4a6d-a20c-f9c0244e3d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:43.531929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07211715-5482-4eaa-90a9-840230cf2318 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:43.532003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83aeaee-2002-4a6d-a20c-f9c0244e3d2e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:43.533431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 55/106] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:43.534875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd0c56-4349-4600-9f62-f4ee7aa6beef None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.535392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd0c56-4349-4600-9f62-f4ee7aa6beef None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.535869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd0c56-4349-4600-9f62-f4ee7aa6beef None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.537683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 56/107] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:43.543346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a86fb-6291-4873-9494-720a5af7e6f6 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.543878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a86fb-6291-4873-9494-720a5af7e6f6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.544392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a86fb-6291-4873-9494-720a5af7e6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.571986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e25a86fb-6291-4873-9494-720a5af7e6f6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:43.574859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e25a86fb-6291-4873-9494-720a5af7e6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:43.586553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226991e-84ff-438a-9f5c-587cc25ede63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:43.587731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226991e-84ff-438a-9f5c-587cc25ede63 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.588240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226991e-84ff-438a-9f5c-587cc25ede63 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.588727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226991e-84ff-438a-9f5c-587cc25ede63 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.590167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226991e-84ff-438a-9f5c-587cc25ede63 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:43.591965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226991e-84ff-438a-9f5c-587cc25ede63 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:43.598231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 52/108] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:43 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:43.599327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226991e-84ff-438a-9f5c-587cc25ede63 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:43.674627 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 57/109] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:43.675809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a86fb-6291-4873-9494-720a5af7e6f6 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:43.708858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226991e-84ff-438a-9f5c-587cc25ede63 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:43.744349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65889b0-6f1e-45b9-84d8-b3a7516429d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:43.745392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65889b0-6f1e-45b9-84d8-b3a7516429d3 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.745934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65889b0-6f1e-45b9-84d8-b3a7516429d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.746467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65889b0-6f1e-45b9-84d8-b3a7516429d3 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.747441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65889b0-6f1e-45b9-84d8-b3a7516429d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:43.749500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65889b0-6f1e-45b9-84d8-b3a7516429d3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:43.774733 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 53/110] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:10:43 2022] POST /identity/v3/projects => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:43.776326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9517-d77a-4e8b-9e2c-f664752aa11c None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.776812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9517-d77a-4e8b-9e2c-f664752aa11c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.777303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9517-d77a-4e8b-9e2c-f664752aa11c None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.779498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 54/111] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:43.780559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9517-d77a-4e8b-9e2c-f664752aa11c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:43.818905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a86fb-6291-4873-9494-720a5af7e6f6 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:43.866259 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f993ae0-e1cb-4f96-9598-4bc4b72ea91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:43.867899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993ae0-e1cb-4f96-9598-4bc4b72ea91d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.868838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993ae0-e1cb-4f96-9598-4bc4b72ea91d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.869332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993ae0-e1cb-4f96-9598-4bc4b72ea91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.871093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f993ae0-e1cb-4f96-9598-4bc4b72ea91d None admin] RBAC: Adding query filter params (role.id=d81e3775c6c34914af06f7580faa79bf, scope.project.id=55d0918683154136b5f35d663a2df767, user.id=3304ca1661ce470dbb2749289827ff07) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:43.871709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f993ae0-e1cb-4f96-9598-4bc4b72ea91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:43.874187 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f993ae0-e1cb-4f96-9598-4bc4b72ea91d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:43.882475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 58/112] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:43 2022] GET /identity/v3/role_assignments?user.id=3304ca1661ce470dbb2749289827ff07&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=d81e3775c6c34914af06f7580faa79bf => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:43.884882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea428d05-538c-4465-b86d-90b2d074553b None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.885441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea428d05-538c-4465-b86d-90b2d074553b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.885926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea428d05-538c-4465-b86d-90b2d074553b None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.888105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 59/113] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:43.895138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cf565-356c-4ee0-ac83-71895c64efc1 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:43.895794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cf565-356c-4ee0-ac83-71895c64efc1 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:43.896280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cf565-356c-4ee0-ac83-71895c64efc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:43.919657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9517-d77a-4e8b-9e2c-f664752aa11c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:43.923517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ec5cf565-356c-4ee0-ac83-71895c64efc1 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:43.926319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ec5cf565-356c-4ee0-ac83-71895c64efc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:44.000136 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f44d9-694d-40c4-a2c0-1505ad5c1a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:44.000962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f44d9-694d-40c4-a2c0-1505ad5c1a87 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.001253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f44d9-694d-40c4-a2c0-1505ad5c1a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.001528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f44d9-694d-40c4-a2c0-1505ad5c1a87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.016761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f44d9-694d-40c4-a2c0-1505ad5c1a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:44.026459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-d41f44d9-694d-40c4-a2c0-1505ad5c1a87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:10:44.028751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 55/114] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:44.030943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d062f3d-e2e1-4122-8d89-d8ab5afdc82d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.031463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d062f3d-e2e1-4122-8d89-d8ab5afdc82d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.031986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d062f3d-e2e1-4122-8d89-d8ab5afdc82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.054164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 60/115] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:44.055759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cf565-356c-4ee0-ac83-71895c64efc1 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:44.057523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-0d062f3d-e2e1-4122-8d89-d8ab5afdc82d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:44.060338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0d062f3d-e2e1-4122-8d89-d8ab5afdc82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:44.146533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 56/116] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:44.147421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d062f3d-e2e1-4122-8d89-d8ab5afdc82d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:44.189271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cf565-356c-4ee0-ac83-71895c64efc1 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:44.240246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebb6d9-80cf-4b8b-a242-d471f42e1e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:44.240935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebb6d9-80cf-4b8b-a242-d471f42e1e46 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.241222 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebb6d9-80cf-4b8b-a242-d471f42e1e46 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.241502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebb6d9-80cf-4b8b-a242-d471f42e1e46 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.242850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebb6d9-80cf-4b8b-a242-d471f42e1e46 None admin] RBAC: Adding query filter params (name=member) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:44.243163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebb6d9-80cf-4b8b-a242-d471f42e1e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:44.244564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebb6d9-80cf-4b8b-a242-d471f42e1e46 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:44.260131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 61/117] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:44.260976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebb6d9-80cf-4b8b-a242-d471f42e1e46 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:44.282664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d062f3d-e2e1-4122-8d89-d8ab5afdc82d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:44.334396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e453a-ccca-4532-808d-4b9e80130640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:44.335197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e453a-ccca-4532-808d-4b9e80130640 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.335493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e453a-ccca-4532-808d-4b9e80130640 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.335800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e453a-ccca-4532-808d-4b9e80130640 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.346330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e453a-ccca-4532-808d-4b9e80130640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:44.357204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-9f0e453a-ccca-4532-808d-4b9e80130640 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:10:44.357204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 57/118] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:10:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:44.357204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e453a-ccca-4532-808d-4b9e80130640 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:44.462612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebb6d9-80cf-4b8b-a242-d471f42e1e46 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:44.474363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e453a-ccca-4532-808d-4b9e80130640 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:44.497194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19909b-a9c3-40a5-84f0-dd7edec587d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:44.498324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19909b-a9c3-40a5-84f0-dd7edec587d8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.498838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19909b-a9c3-40a5-84f0-dd7edec587d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.499320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19909b-a9c3-40a5-84f0-dd7edec587d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.508268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f976c-ec0f-46f6-979c-b961e8db33b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:44.509140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f976c-ec0f-46f6-979c-b961e8db33b2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.509462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f976c-ec0f-46f6-979c-b961e8db33b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.509882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f976c-ec0f-46f6-979c-b961e8db33b2 None admin] PATH_INFO: `/v3/users/62c6a5f644564d4ea81a8a00bc3dc990` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.510696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19909b-a9c3-40a5-84f0-dd7edec587d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:44.511236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f976c-ec0f-46f6-979c-b961e8db33b2 None admin] RBAC: Authorizing `identity:get_user(user_id=62c6a5f644564d4ea81a8a00bc3dc990)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:44.512793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f976c-ec0f-46f6-979c-b961e8db33b2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:44.514458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 58/119] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:44 2022] GET /identity/v3/users/62c6a5f644564d4ea81a8a00bc3dc990 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:44.515219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f976c-ec0f-46f6-979c-b961e8db33b2 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:44.519447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-6c19909b-a9c3-40a5-84f0-dd7edec587d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:10:44.521100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 62/120] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:44.522730 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a6eb5-62de-4174-836e-e6aa5b94e005 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.523784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a6eb5-62de-4174-836e-e6aa5b94e005 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.524413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a6eb5-62de-4174-836e-e6aa5b94e005 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.526827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 63/121] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:44.527844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a6eb5-62de-4174-836e-e6aa5b94e005 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:44.631798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a6eb5-62de-4174-836e-e6aa5b94e005 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:44.641514 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f976c-ec0f-46f6-979c-b961e8db33b2 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:44.666133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39347f-6f87-4e92-98ee-e64656419539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:44.667319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39347f-6f87-4e92-98ee-e64656419539 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.667823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39347f-6f87-4e92-98ee-e64656419539 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.668325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39347f-6f87-4e92-98ee-e64656419539 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.669766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39347f-6f87-4e92-98ee-e64656419539 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:44.671645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39347f-6f87-4e92-98ee-e64656419539 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:44.673878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 64/122] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:44 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:44.675068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39347f-6f87-4e92-98ee-e64656419539 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:44.691247 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a5329-50a1-4b30-8e70-24cb56ca24d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:44.692144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a5329-50a1-4b30-8e70-24cb56ca24d7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.692443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a5329-50a1-4b30-8e70-24cb56ca24d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.692780 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a5329-50a1-4b30-8e70-24cb56ca24d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.693967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a5329-50a1-4b30-8e70-24cb56ca24d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:44.694321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a5329-50a1-4b30-8e70-24cb56ca24d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:44.696130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a5329-50a1-4b30-8e70-24cb56ca24d7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:44.707868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 59/123] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:44.711346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ae347-095c-4cb0-ace4-795597c4fa5b None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.711862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ae347-095c-4cb0-ace4-795597c4fa5b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.712351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ae347-095c-4cb0-ace4-795597c4fa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.735020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-058ae347-095c-4cb0-ace4-795597c4fa5b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:44.736620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-058ae347-095c-4cb0-ace4-795597c4fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:44.785356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39347f-6f87-4e92-98ee-e64656419539 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:44.820014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ad5d3-8da0-4806-bd21-282806bd460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:44.821590 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ad5d3-8da0-4806-bd21-282806bd460c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.822078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ad5d3-8da0-4806-bd21-282806bd460c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.822608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ad5d3-8da0-4806-bd21-282806bd460c None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.823559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ad5d3-8da0-4806-bd21-282806bd460c None admin] RBAC: Adding query filter params (name=member) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:44.824068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ad5d3-8da0-4806-bd21-282806bd460c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:44.825371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 60/124] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:44.825942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ad5d3-8da0-4806-bd21-282806bd460c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:44.826352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ae347-095c-4cb0-ace4-795597c4fa5b None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:44.834917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 65/125] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:44.836674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ad5d3-8da0-4806-bd21-282806bd460c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:44.933721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ae347-095c-4cb0-ace4-795597c4fa5b None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:44.954236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ad5d3-8da0-4806-bd21-282806bd460c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:44.968648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0c3e0-32fd-4bf3-be1f-99d157d5c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:44.969847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0c3e0-32fd-4bf3-be1f-99d157d5c85d None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:44.970389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0c3e0-32fd-4bf3-be1f-99d157d5c85d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:44.970902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0c3e0-32fd-4bf3-be1f-99d157d5c85d None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767/users/62c6a5f644564d4ea81a8a00bc3dc990/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:44.973139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0c3e0-32fd-4bf3-be1f-99d157d5c85d None admin] RBAC: Authorizing `identity:create_grant(project_id=55d0918683154136b5f35d663a2df767, user_id=62c6a5f644564d4ea81a8a00bc3dc990, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:44.974908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0c3e0-32fd-4bf3-be1f-99d157d5c85d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:44.997356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 61/126] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:10:44 2022] PUT /identity/v3/projects/55d0918683154136b5f35d663a2df767/users/62c6a5f644564d4ea81a8a00bc3dc990/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:10:45.002181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0c3e0-32fd-4bf3-be1f-99d157d5c85d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:45.006061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa53c91-9344-4cab-bd18-7b632584b6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:45.011482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa53c91-9344-4cab-bd18-7b632584b6e9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:45.012019 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa53c91-9344-4cab-bd18-7b632584b6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:45.012455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa53c91-9344-4cab-bd18-7b632584b6e9 None admin] PATH_INFO: `/v3/users/fd873144a6ac489d9c499e77ba96e536` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:45.014038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa53c91-9344-4cab-bd18-7b632584b6e9 None admin] RBAC: Authorizing `identity:get_user(user_id=fd873144a6ac489d9c499e77ba96e536)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:45.017520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa53c91-9344-4cab-bd18-7b632584b6e9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:45.027065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 66/127] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:44 2022] GET /identity/v3/users/fd873144a6ac489d9c499e77ba96e536 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:45.030501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa53c91-9344-4cab-bd18-7b632584b6e9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:45.205995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0c3e0-32fd-4bf3-be1f-99d157d5c85d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:45.208753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa53c91-9344-4cab-bd18-7b632584b6e9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:45.256828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fd52f-b544-42e7-a429-f7f888b2c8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:45.258299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fd52f-b544-42e7-a429-f7f888b2c8cb None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:45.258595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fd52f-b544-42e7-a429-f7f888b2c8cb None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:45.258877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fd52f-b544-42e7-a429-f7f888b2c8cb None admin] PATH_INFO: `/v3/users/62c6a5f644564d4ea81a8a00bc3dc990` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:45.259160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43365-5c2e-4f60-8495-7006099eb43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:45.259976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43365-5c2e-4f60-8495-7006099eb43a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:45.260090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fd52f-b544-42e7-a429-f7f888b2c8cb None admin] RBAC: Authorizing `identity:get_user(user_id=62c6a5f644564d4ea81a8a00bc3dc990)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:45.260260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43365-5c2e-4f60-8495-7006099eb43a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:45.260537 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43365-5c2e-4f60-8495-7006099eb43a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:45.261541 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fd52f-b544-42e7-a429-f7f888b2c8cb None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:45.263747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 62/128] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:44 2022] GET /identity/v3/users/62c6a5f644564d4ea81a8a00bc3dc990 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:45.264606 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fd52f-b544-42e7-a429-f7f888b2c8cb None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:45.277441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf43365-5c2e-4f60-8495-7006099eb43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:45.287208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-aaf43365-5c2e-4f60-8495-7006099eb43a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:10:45.288449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 67/129] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:10:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:45.289274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43365-5c2e-4f60-8495-7006099eb43a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:45.401658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fd52f-b544-42e7-a429-f7f888b2c8cb None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:45.428857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43365-5c2e-4f60-8495-7006099eb43a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:45.447469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abb0df-bad4-4665-95f1-1ee4b5043cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:45.448707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abb0df-bad4-4665-95f1-1ee4b5043cad None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:45.449197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abb0df-bad4-4665-95f1-1ee4b5043cad None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:45.449667 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abb0df-bad4-4665-95f1-1ee4b5043cad None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:45.451092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abb0df-bad4-4665-95f1-1ee4b5043cad None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:45.452745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abb0df-bad4-4665-95f1-1ee4b5043cad None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:45.454971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 63/130] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:45 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:45.455957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abb0df-bad4-4665-95f1-1ee4b5043cad None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:45.486456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3efd-1d80-46c5-b88e-760ebb19cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:45.487339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3efd-1d80-46c5-b88e-760ebb19cf51 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:45.487626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3efd-1d80-46c5-b88e-760ebb19cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:45.488172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3efd-1d80-46c5-b88e-760ebb19cf51 None admin] PATH_INFO: `/v3/projects/ad48d2adb0e544498efea215d45fa715` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:45.494887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e3efd-1d80-46c5-b88e-760ebb19cf51 None admin] RBAC: Authorizing `identity:get_project(project_id=ad48d2adb0e544498efea215d45fa715)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:45.496362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e3efd-1d80-46c5-b88e-760ebb19cf51 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:45.498471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 68/131] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:45 2022] GET /identity/v3/projects/ad48d2adb0e544498efea215d45fa715 => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:45.499563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3efd-1d80-46c5-b88e-760ebb19cf51 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:45.567843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abb0df-bad4-4665-95f1-1ee4b5043cad None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:45.613935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40d878-5706-42fb-8f7a-53ae4a31009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:45.615493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40d878-5706-42fb-8f7a-53ae4a31009a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:45.616107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40d878-5706-42fb-8f7a-53ae4a31009a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:45.616581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40d878-5706-42fb-8f7a-53ae4a31009a None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:45.618124 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40d878-5706-42fb-8f7a-53ae4a31009a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:45.618651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40d878-5706-42fb-8f7a-53ae4a31009a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:45.620234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40d878-5706-42fb-8f7a-53ae4a31009a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:45.629757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 64/132] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:10:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:45.631351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40d878-5706-42fb-8f7a-53ae4a31009a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:45.760559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40d878-5706-42fb-8f7a-53ae4a31009a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:45.765967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3efd-1d80-46c5-b88e-760ebb19cf51 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:45.803336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17739e90-c4ab-4b60-ac12-4f1dfd888cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:45.805190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17739e90-c4ab-4b60-ac12-4f1dfd888cc5 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:45.805678 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17739e90-c4ab-4b60-ac12-4f1dfd888cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:45.806187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17739e90-c4ab-4b60-ac12-4f1dfd888cc5 None admin] PATH_INFO: `/v3/projects/ad48d2adb0e544498efea215d45fa715/users/62c6a5f644564d4ea81a8a00bc3dc990/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:45.809119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17739e90-c4ab-4b60-ac12-4f1dfd888cc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad48d2adb0e544498efea215d45fa715, user_id=62c6a5f644564d4ea81a8a00bc3dc990, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:45.810834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17739e90-c4ab-4b60-ac12-4f1dfd888cc5 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:45.827806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 65/133] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:10:45 2022] PUT /identity/v3/projects/ad48d2adb0e544498efea215d45fa715/users/62c6a5f644564d4ea81a8a00bc3dc990/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:10:45.830063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17739e90-c4ab-4b60-ac12-4f1dfd888cc5 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:45.866916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb5d5e-048a-4548-aaaa-3eeb208f4c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:45.868008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5d5e-048a-4548-aaaa-3eeb208f4c9f None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:45.868202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5d5e-048a-4548-aaaa-3eeb208f4c9f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:45.868482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5d5e-048a-4548-aaaa-3eeb208f4c9f None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767/users/fd873144a6ac489d9c499e77ba96e536/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:45.875085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb5d5e-048a-4548-aaaa-3eeb208f4c9f None admin] RBAC: Authorizing `identity:create_grant(project_id=55d0918683154136b5f35d663a2df767, user_id=fd873144a6ac489d9c499e77ba96e536, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:45.876593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb5d5e-048a-4548-aaaa-3eeb208f4c9f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:45.902567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 69/134] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:10:45 2022] PUT /identity/v3/projects/55d0918683154136b5f35d663a2df767/users/fd873144a6ac489d9c499e77ba96e536/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:10:45.984192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17739e90-c4ab-4b60-ac12-4f1dfd888cc5 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:46.038791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c5ec-9eca-4536-b9fd-efeb3062b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:46.044195 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c5ec-9eca-4536-b9fd-efeb3062b8ce None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:46.044980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c5ec-9eca-4536-b9fd-efeb3062b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:46.045640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c5ec-9eca-4536-b9fd-efeb3062b8ce None admin] PATH_INFO: `/v3/users/62c6a5f644564d4ea81a8a00bc3dc990` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:46.048202 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0c5ec-9eca-4536-b9fd-efeb3062b8ce None admin] RBAC: Authorizing `identity:get_user(user_id=62c6a5f644564d4ea81a8a00bc3dc990)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:46.051156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0c5ec-9eca-4536-b9fd-efeb3062b8ce None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:46.054007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 66/135] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:45 2022] GET /identity/v3/users/62c6a5f644564d4ea81a8a00bc3dc990 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:46.059947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb5d5e-048a-4548-aaaa-3eeb208f4c9f None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:46.240557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb5d5e-048a-4548-aaaa-3eeb208f4c9f None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:46.281827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540a97b-69aa-4981-abd0-1441e9f71edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:46.282737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540a97b-69aa-4981-abd0-1441e9f71edb None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:46.283030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540a97b-69aa-4981-abd0-1441e9f71edb None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:46.283312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540a97b-69aa-4981-abd0-1441e9f71edb None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:46.286826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540a97b-69aa-4981-abd0-1441e9f71edb None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:46.288297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540a97b-69aa-4981-abd0-1441e9f71edb None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:46.290417 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 70/136] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:46 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:46.296239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c5ec-9eca-4536-b9fd-efeb3062b8ce None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:46.405441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c5ec-9eca-4536-b9fd-efeb3062b8ce None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:46.438646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fafb8-dcb2-4e08-99d7-8a1ae23298ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:46.439879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fafb8-dcb2-4e08-99d7-8a1ae23298ef None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:46.440380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fafb8-dcb2-4e08-99d7-8a1ae23298ef None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:46.440859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fafb8-dcb2-4e08-99d7-8a1ae23298ef None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767/users/62c6a5f644564d4ea81a8a00bc3dc990/roles/59b67f94d2af48b08b7bef41a8396bfb` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:46.443647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fafb8-dcb2-4e08-99d7-8a1ae23298ef None admin] RBAC: Authorizing `identity:create_grant(project_id=55d0918683154136b5f35d663a2df767, user_id=62c6a5f644564d4ea81a8a00bc3dc990, role_id=59b67f94d2af48b08b7bef41a8396bfb)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:46.445867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fafb8-dcb2-4e08-99d7-8a1ae23298ef None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:46.479562 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 67/137] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:10:46 2022] PUT /identity/v3/projects/55d0918683154136b5f35d663a2df767/users/62c6a5f644564d4ea81a8a00bc3dc990/roles/59b67f94d2af48b08b7bef41a8396bfb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:10:46.596933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c918b-db5f-46bf-92c5-def6808c9045 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:46.597432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c918b-db5f-46bf-92c5-def6808c9045 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:46.597432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c918b-db5f-46bf-92c5-def6808c9045 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:46.599447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 71/138] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:46.605598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f8932-cde7-4567-a41d-ef847999f55b None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:46.606560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f8932-cde7-4567-a41d-ef847999f55b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:46.607035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f8932-cde7-4567-a41d-ef847999f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:46.630496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ea1f8932-cde7-4567-a41d-ef847999f55b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:46.633448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ea1f8932-cde7-4567-a41d-ef847999f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:46.718633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 68/139] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:46.760746 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c918b-db5f-46bf-92c5-def6808c9045 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:46.761779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f4c4-7006-4077-9832-7e272edf0d36 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:46.762303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f4c4-7006-4077-9832-7e272edf0d36 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:46.762779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f4c4-7006-4077-9832-7e272edf0d36 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:46.764939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 69/140] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:46.786750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8736fe8-fe27-4007-8f90-11c10bad789a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:46.787524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8736fe8-fe27-4007-8f90-11c10bad789a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:46.787994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8736fe8-fe27-4007-8f90-11c10bad789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:46.806475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e8736fe8-fe27-4007-8f90-11c10bad789a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:46.808421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e8736fe8-fe27-4007-8f90-11c10bad789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:46.877595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 70/141] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:46.915711 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c918b-db5f-46bf-92c5-def6808c9045 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:46.953048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8736fe8-fe27-4007-8f90-11c10bad789a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:46.954572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394ac7-9ed0-4920-aeb8-90e4105ff6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:46.955395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394ac7-9ed0-4920-aeb8-90e4105ff6cb None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:46.955682 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394ac7-9ed0-4920-aeb8-90e4105ff6cb None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:46.955958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394ac7-9ed0-4920-aeb8-90e4105ff6cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:46.974343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394ac7-9ed0-4920-aeb8-90e4105ff6cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:46.981851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-d6394ac7-9ed0-4920-aeb8-90e4105ff6cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 17:10:46.983081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 72/142] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:46.988778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394ac7-9ed0-4920-aeb8-90e4105ff6cb None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:47.053076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8736fe8-fe27-4007-8f90-11c10bad789a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:47.099623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea706e0-0200-4a4d-bfd4-1b5a984afe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:47.100877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea706e0-0200-4a4d-bfd4-1b5a984afe54 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:47.101334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea706e0-0200-4a4d-bfd4-1b5a984afe54 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:47.101772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea706e0-0200-4a4d-bfd4-1b5a984afe54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:47.103609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea706e0-0200-4a4d-bfd4-1b5a984afe54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:47.105111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea706e0-0200-4a4d-bfd4-1b5a984afe54 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:47.109650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 71/143] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:47.114966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea706e0-0200-4a4d-bfd4-1b5a984afe54 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:47.158505 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394ac7-9ed0-4920-aeb8-90e4105ff6cb None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:47.222820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573e1cd-064f-458b-b28c-31d930444120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:47.223514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573e1cd-064f-458b-b28c-31d930444120 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:47.223801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573e1cd-064f-458b-b28c-31d930444120 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:47.224077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573e1cd-064f-458b-b28c-31d930444120 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:47.224827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573e1cd-064f-458b-b28c-31d930444120 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:47.225134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573e1cd-064f-458b-b28c-31d930444120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:47.226608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573e1cd-064f-458b-b28c-31d930444120 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:47.242010 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 73/144] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:47.247584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573e1cd-064f-458b-b28c-31d930444120 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:47.342716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea706e0-0200-4a4d-bfd4-1b5a984afe54 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:47.428570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb90c7b-e844-40fa-910e-0f8a2b0dc4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:47.429634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb90c7b-e844-40fa-910e-0f8a2b0dc4ea None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:47.430149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb90c7b-e844-40fa-910e-0f8a2b0dc4ea None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:47.430617 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb90c7b-e844-40fa-910e-0f8a2b0dc4ea None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:47.431537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb90c7b-e844-40fa-910e-0f8a2b0dc4ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:47.433190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb90c7b-e844-40fa-910e-0f8a2b0dc4ea None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:47.461287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573e1cd-064f-458b-b28c-31d930444120 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:47.468575 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 72/145] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:10:47 2022] POST /identity/v3/users => generated 283 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:47.514208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33d4f-7200-4656-910c-a0c3b73a14e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:47.515469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33d4f-7200-4656-910c-a0c3b73a14e1 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:47.515976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33d4f-7200-4656-910c-a0c3b73a14e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:47.516443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33d4f-7200-4656-910c-a0c3b73a14e1 None admin] PATH_INFO: `/v3/users/3304ca1661ce470dbb2749289827ff07` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:47.523927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33d4f-7200-4656-910c-a0c3b73a14e1 None admin] RBAC: Authorizing `identity:get_user(user_id=3304ca1661ce470dbb2749289827ff07)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:47.525863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33d4f-7200-4656-910c-a0c3b73a14e1 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:47.528338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 74/146] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:47 2022] GET /identity/v3/users/3304ca1661ce470dbb2749289827ff07 => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:47.533548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb90c7b-e844-40fa-910e-0f8a2b0dc4ea None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:47.654031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb90c7b-e844-40fa-910e-0f8a2b0dc4ea None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:47.693548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfae0b-8baa-4bf3-a56a-41c386c7e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:47.694387 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfae0b-8baa-4bf3-a56a-41c386c7e61b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:47.694725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfae0b-8baa-4bf3-a56a-41c386c7e61b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:47.695001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfae0b-8baa-4bf3-a56a-41c386c7e61b None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:47.696279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfae0b-8baa-4bf3-a56a-41c386c7e61b None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:47.697754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfae0b-8baa-4bf3-a56a-41c386c7e61b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:47.699495 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 73/147] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:47 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:47.705434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33d4f-7200-4656-910c-a0c3b73a14e1 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:47.848591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33d4f-7200-4656-910c-a0c3b73a14e1 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:47.889829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c843-256d-4f87-a65b-8099716985b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:47.891161 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c843-256d-4f87-a65b-8099716985b5 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:47.891667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c843-256d-4f87-a65b-8099716985b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:47.892142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c843-256d-4f87-a65b-8099716985b5 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767/users/3304ca1661ce470dbb2749289827ff07/roles/d81e3775c6c34914af06f7580faa79bf` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:47.900372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7c843-256d-4f87-a65b-8099716985b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d0918683154136b5f35d663a2df767, user_id=3304ca1661ce470dbb2749289827ff07, role_id=d81e3775c6c34914af06f7580faa79bf)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:47.902240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7c843-256d-4f87-a65b-8099716985b5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:47.924906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 75/148] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:10:47 2022] PUT /identity/v3/projects/55d0918683154136b5f35d663a2df767/users/3304ca1661ce470dbb2749289827ff07/roles/d81e3775c6c34914af06f7580faa79bf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:10:48.725506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6c64-eae4-4f75-ad81-3981b7699f0d None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:48.726010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6c64-eae4-4f75-ad81-3981b7699f0d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:48.726165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6c64-eae4-4f75-ad81-3981b7699f0d None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:48.728589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 74/149] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:48.733531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d336ef4-c5b2-454a-b407-e8884039960b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:48.734390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d336ef4-c5b2-454a-b407-e8884039960b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:48.734866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d336ef4-c5b2-454a-b407-e8884039960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:48.759129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-2d336ef4-c5b2-454a-b407-e8884039960b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:48.760651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2d336ef4-c5b2-454a-b407-e8884039960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:48.844050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:48.887649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c6c64-eae4-4f75-ad81-3981b7699f0d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:48.996930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c6c64-eae4-4f75-ad81-3981b7699f0d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:49.034551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d12382-305c-49ae-8191-b538ee3b93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:49.035410 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d12382-305c-49ae-8191-b538ee3b93cb None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:49.035701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d12382-305c-49ae-8191-b538ee3b93cb None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:49.035977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d12382-305c-49ae-8191-b538ee3b93cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:49.048442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d12382-305c-49ae-8191-b538ee3b93cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:49.055574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-e0d12382-305c-49ae-8191-b538ee3b93cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:10:49.057015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 75/151] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:49.062935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d336ef4-c5b2-454a-b407-e8884039960b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:49.208979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d336ef4-c5b2-454a-b407-e8884039960b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:49.243649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf34d5-5b7b-45df-ab5d-9c66dfec1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:49.244330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf34d5-5b7b-45df-ab5d-9c66dfec1a0c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:49.244611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf34d5-5b7b-45df-ab5d-9c66dfec1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:49.244884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf34d5-5b7b-45df-ab5d-9c66dfec1a0c None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:49.245630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf34d5-5b7b-45df-ab5d-9c66dfec1a0c None admin] RBAC: Adding query filter params (name=member) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:49.245935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf34d5-5b7b-45df-ab5d-9c66dfec1a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:49.247397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf34d5-5b7b-45df-ab5d-9c66dfec1a0c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:49.260119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 77/152] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:49.266545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d12382-305c-49ae-8191-b538ee3b93cb None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:49.392484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d12382-305c-49ae-8191-b538ee3b93cb None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:49.426971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2db68-5a49-4f78-9433-b32eff80d582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:49.428263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2db68-5a49-4f78-9433-b32eff80d582 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:49.428744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2db68-5a49-4f78-9433-b32eff80d582 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:49.429215 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2db68-5a49-4f78-9433-b32eff80d582 None admin] PATH_INFO: `/v3/users/62c6a5f644564d4ea81a8a00bc3dc990` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:49.430749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2db68-5a49-4f78-9433-b32eff80d582 None admin] RBAC: Authorizing `identity:get_user(user_id=62c6a5f644564d4ea81a8a00bc3dc990)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:49.432434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2db68-5a49-4f78-9433-b32eff80d582 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:49.434357 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 76/153] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:49 2022] GET /identity/v3/users/62c6a5f644564d4ea81a8a00bc3dc990 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:49.440222 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf34d5-5b7b-45df-ab5d-9c66dfec1a0c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:49.543759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf34d5-5b7b-45df-ab5d-9c66dfec1a0c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:49.578331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233f9ec-f385-47d0-8ad7-36a0bb8ca2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:49.579464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233f9ec-f385-47d0-8ad7-36a0bb8ca2a2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:49.579952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233f9ec-f385-47d0-8ad7-36a0bb8ca2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:49.580438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233f9ec-f385-47d0-8ad7-36a0bb8ca2a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:49.649885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233f9ec-f385-47d0-8ad7-36a0bb8ca2a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:49.651713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233f9ec-f385-47d0-8ad7-36a0bb8ca2a2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:49.753476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e73b-a0ad-4417-a862-e21a96aed34d None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:49.754494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e73b-a0ad-4417-a862-e21a96aed34d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:49.754975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e73b-a0ad-4417-a862-e21a96aed34d None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:49.756931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 77/154] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:10:49.759269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 78/155] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:49.763466 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5e64-9618-4b71-b205-26d733826968 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:49.763952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5e64-9618-4b71-b205-26d733826968 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:49.764479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5e64-9618-4b71-b205-26d733826968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:49.779220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233f9ec-f385-47d0-8ad7-36a0bb8ca2a2 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:49.797111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-784a5e64-9618-4b71-b205-26d733826968 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:49.799682 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-784a5e64-9618-4b71-b205-26d733826968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:49.938124 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 78/156] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:10:49.953109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233f9ec-f385-47d0-8ad7-36a0bb8ca2a2 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:49.973469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5e64-9618-4b71-b205-26d733826968 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:50.005701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578a6c8-908d-4318-a84a-0647e92fdfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:50.006984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578a6c8-908d-4318-a84a-0647e92fdfe3 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.007919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578a6c8-908d-4318-a84a-0647e92fdfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.008400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578a6c8-908d-4318-a84a-0647e92fdfe3 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.009796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578a6c8-908d-4318-a84a-0647e92fdfe3 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:50.011882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578a6c8-908d-4318-a84a-0647e92fdfe3 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:50.013956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 79/157] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:49 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:50.022798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578a6c8-908d-4318-a84a-0647e92fdfe3 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:50.131894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578a6c8-908d-4318-a84a-0647e92fdfe3 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:50.169451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0e59d-9109-408c-a85e-b2703d497d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:50.170904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e59d-9109-408c-a85e-b2703d497d91 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.171421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e59d-9109-408c-a85e-b2703d497d91 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.171900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e59d-9109-408c-a85e-b2703d497d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.173292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0e59d-9109-408c-a85e-b2703d497d91 None admin] RBAC: Adding query filter params (role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=55d0918683154136b5f35d663a2df767, user.id=62c6a5f644564d4ea81a8a00bc3dc990) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:50.173860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0e59d-9109-408c-a85e-b2703d497d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:50.175581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0e59d-9109-408c-a85e-b2703d497d91 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:50.182069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 80/158] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:50 2022] GET /identity/v3/role_assignments?user.id=62c6a5f644564d4ea81a8a00bc3dc990&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=43e227d04ba64588acce441d98a394f3 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:50.184350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c2bb-62ce-4072-a644-2413f98afde3 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.184872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c2bb-62ce-4072-a644-2413f98afde3 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.185496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c2bb-62ce-4072-a644-2413f98afde3 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.187447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 81/159] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:50.197001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37af20-913d-4a16-9811-f89213c92e9b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.197610 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37af20-913d-4a16-9811-f89213c92e9b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.198084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37af20-913d-4a16-9811-f89213c92e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.216253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5e64-9618-4b71-b205-26d733826968 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:50.220209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-7f37af20-913d-4a16-9811-f89213c92e9b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:50.226860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7f37af20-913d-4a16-9811-f89213c92e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:50.314851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0059e-cc46-4d39-97a5-d1a4f33a7b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:50.315683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0059e-cc46-4d39-97a5-d1a4f33a7b65 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.315958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0059e-cc46-4d39-97a5-d1a4f33a7b65 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.316419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0059e-cc46-4d39-97a5-d1a4f33a7b65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.345039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 82/160] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:50.362891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0059e-cc46-4d39-97a5-d1a4f33a7b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:50.370564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-9bd0059e-cc46-4d39-97a5-d1a4f33a7b65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:10:50.372137 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 79/161] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:10:50.377605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37af20-913d-4a16-9811-f89213c92e9b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:50.400635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0059e-cc46-4d39-97a5-d1a4f33a7b65 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:50.494154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37af20-913d-4a16-9811-f89213c92e9b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:50.535690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6ba10-e43d-4a48-887a-c8744d03ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:50.536665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6ba10-e43d-4a48-887a-c8744d03ac7a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.537120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6ba10-e43d-4a48-887a-c8744d03ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.537720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6ba10-e43d-4a48-887a-c8744d03ac7a None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.538644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6ba10-e43d-4a48-887a-c8744d03ac7a None admin] RBAC: Adding query filter params (name=member) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:50.539602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6ba10-e43d-4a48-887a-c8744d03ac7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:50.541290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6ba10-e43d-4a48-887a-c8744d03ac7a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:50.551665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 83/162] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:50.557965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6ba10-e43d-4a48-887a-c8744d03ac7a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:50.610289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0059e-cc46-4d39-97a5-d1a4f33a7b65 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:50.704355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b802538-99e0-43e9-b839-f7e8ff1d5f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:50.708658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6ba10-e43d-4a48-887a-c8744d03ac7a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:50.710532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b802538-99e0-43e9-b839-f7e8ff1d5f6f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.710865 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b802538-99e0-43e9-b839-f7e8ff1d5f6f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.711145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b802538-99e0-43e9-b839-f7e8ff1d5f6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.734414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b802538-99e0-43e9-b839-f7e8ff1d5f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:50.741494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-7b802538-99e0-43e9-b839-f7e8ff1d5f6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:10:50.745520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7d25a-09fc-4956-8821-30ecb3d2d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:50.746636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7d25a-09fc-4956-8821-30ecb3d2d170 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.747135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 80/163] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:10:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:10:50.747516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7d25a-09fc-4956-8821-30ecb3d2d170 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.748049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7d25a-09fc-4956-8821-30ecb3d2d170 None admin] PATH_INFO: `/v3/users/62c6a5f644564d4ea81a8a00bc3dc990` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.749433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7d25a-09fc-4956-8821-30ecb3d2d170 None admin] RBAC: Authorizing `identity:get_user(user_id=62c6a5f644564d4ea81a8a00bc3dc990)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:50.751171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7d25a-09fc-4956-8821-30ecb3d2d170 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:50.752558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b802538-99e0-43e9-b839-f7e8ff1d5f6f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:50.753624 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 84/164] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:50 2022] GET /identity/v3/users/62c6a5f644564d4ea81a8a00bc3dc990 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:50.759269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7d25a-09fc-4956-8821-30ecb3d2d170 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:50.865525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7d25a-09fc-4956-8821-30ecb3d2d170 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:50.876046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b802538-99e0-43e9-b839-f7e8ff1d5f6f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:50.900360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfd62a-a3fa-48f0-9d9d-f321b1d0cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:50.901241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfd62a-a3fa-48f0-9d9d-f321b1d0cdee None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.901699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfd62a-a3fa-48f0-9d9d-f321b1d0cdee None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.902150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfd62a-a3fa-48f0-9d9d-f321b1d0cdee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.913062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc38a6d-7468-45cb-8634-83227bb8ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:50.914364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc38a6d-7468-45cb-8634-83227bb8ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.914658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc38a6d-7468-45cb-8634-83227bb8ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.914936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc38a6d-7468-45cb-8634-83227bb8ffd4 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.915768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc38a6d-7468-45cb-8634-83227bb8ffd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:50.915999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc38a6d-7468-45cb-8634-83227bb8ffd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:50.917473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc38a6d-7468-45cb-8634-83227bb8ffd4 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:50.926713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 81/165] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:50.928158 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283067b-cba6-4fe2-9e18-78c1c523e93d None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:50.928455 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283067b-cba6-4fe2-9e18-78c1c523e93d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:50.928738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283067b-cba6-4fe2-9e18-78c1c523e93d None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:50.933629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 82/166] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:50.934591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283067b-cba6-4fe2-9e18-78c1c523e93d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:51.012378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfd62a-a3fa-48f0-9d9d-f321b1d0cdee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:51.013892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfd62a-a3fa-48f0-9d9d-f321b1d0cdee None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:51.138773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283067b-cba6-4fe2-9e18-78c1c523e93d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:51.155973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 85/167] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:51.157576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b41be0-e2f2-4a7e-a482-48d50fe8deb6 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:51.157875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b41be0-e2f2-4a7e-a482-48d50fe8deb6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:51.162357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b41be0-e2f2-4a7e-a482-48d50fe8deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:51.182920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-99b41be0-e2f2-4a7e-a482-48d50fe8deb6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:51.184269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-99b41be0-e2f2-4a7e-a482-48d50fe8deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:51.217051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3ae2-f9cd-4b76-b032-68aa1b967f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:51.217986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3ae2-f9cd-4b76-b032-68aa1b967f93 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:51.218303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3ae2-f9cd-4b76-b032-68aa1b967f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:51.218581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3ae2-f9cd-4b76-b032-68aa1b967f93 None admin] PATH_INFO: `/v3/users/fd873144a6ac489d9c499e77ba96e536` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:51.220453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d3ae2-f9cd-4b76-b032-68aa1b967f93 None admin] RBAC: Authorizing `identity:get_user(user_id=fd873144a6ac489d9c499e77ba96e536)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:51.224892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d3ae2-f9cd-4b76-b032-68aa1b967f93 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:51.227434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 83/168] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:50 2022] GET /identity/v3/users/fd873144a6ac489d9c499e77ba96e536 => generated 247 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:51.231839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3ae2-f9cd-4b76-b032-68aa1b967f93 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:51.315925 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 86/169] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:51.316838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b41be0-e2f2-4a7e-a482-48d50fe8deb6 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:51.462774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b41be0-e2f2-4a7e-a482-48d50fe8deb6 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:51.505073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae0610-5de2-4d5d-b3e4-7f7de765e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:51.505736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0610-5de2-4d5d-b3e4-7f7de765e12e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:51.506024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0610-5de2-4d5d-b3e4-7f7de765e12e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:51.506333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0610-5de2-4d5d-b3e4-7f7de765e12e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:51.516199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3ae2-f9cd-4b76-b032-68aa1b967f93 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:51.581004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae0610-5de2-4d5d-b3e4-7f7de765e12e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:51.582437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae0610-5de2-4d5d-b3e4-7f7de765e12e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:51.603688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bd891-fc8a-457e-b9bd-30e147adebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:51.604564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bd891-fc8a-457e-b9bd-30e147adebb3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:51.604841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bd891-fc8a-457e-b9bd-30e147adebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:51.605112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bd891-fc8a-457e-b9bd-30e147adebb3 None admin] PATH_INFO: `/v3/projects/ad48d2adb0e544498efea215d45fa715` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:51.606330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bd891-fc8a-457e-b9bd-30e147adebb3 None admin] RBAC: Authorizing `identity:get_project(project_id=ad48d2adb0e544498efea215d45fa715)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:51.607952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bd891-fc8a-457e-b9bd-30e147adebb3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:51.609639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 84/170] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:51 2022] GET /identity/v3/projects/ad48d2adb0e544498efea215d45fa715 => generated 312 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:51.610429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bd891-fc8a-457e-b9bd-30e147adebb3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:51.693901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 87/171] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:51.694947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae0610-5de2-4d5d-b3e4-7f7de765e12e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:51.797111 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae0610-5de2-4d5d-b3e4-7f7de765e12e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:51.797998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bd891-fc8a-457e-b9bd-30e147adebb3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:51.833891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662a8cb-3d01-43ae-b0ef-b3462b5141b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:51.834523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662a8cb-3d01-43ae-b0ef-b3462b5141b2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:51.834811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662a8cb-3d01-43ae-b0ef-b3462b5141b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:51.835096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662a8cb-3d01-43ae-b0ef-b3462b5141b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:51.836500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662a8cb-3d01-43ae-b0ef-b3462b5141b2 None admin] RBAC: Adding query filter params (role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=ad48d2adb0e544498efea215d45fa715, user.id=62c6a5f644564d4ea81a8a00bc3dc990) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:51.836813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662a8cb-3d01-43ae-b0ef-b3462b5141b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:51.838371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662a8cb-3d01-43ae-b0ef-b3462b5141b2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:51.845351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 88/172] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:51 2022] GET /identity/v3/role_assignments?user.id=62c6a5f644564d4ea81a8a00bc3dc990&scope.project.id=ad48d2adb0e544498efea215d45fa715&role.id=43e227d04ba64588acce441d98a394f3 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:51.846189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662a8cb-3d01-43ae-b0ef-b3462b5141b2 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:51.870302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c489e4-3ff7-4cdc-8791-d4d5fca1eb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:51.871146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c489e4-3ff7-4cdc-8791-d4d5fca1eb67 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:51.871435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c489e4-3ff7-4cdc-8791-d4d5fca1eb67 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:51.871713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c489e4-3ff7-4cdc-8791-d4d5fca1eb67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:51.903226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c489e4-3ff7-4cdc-8791-d4d5fca1eb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:51.910976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-58c489e4-3ff7-4cdc-8791-d4d5fca1eb67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:10:51.912458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 85/173] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:10:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:51.918486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0927be-45bf-45b7-84ef-f79c37c0cc9a None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:51.918785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0927be-45bf-45b7-84ef-f79c37c0cc9a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:51.919065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0927be-45bf-45b7-84ef-f79c37c0cc9a None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:51.921071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 86/174] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:51.921641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0927be-45bf-45b7-84ef-f79c37c0cc9a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:51.952582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662a8cb-3d01-43ae-b0ef-b3462b5141b2 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:51.990009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc4b4f-bd13-4b29-ad72-0794a3479dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:51.991718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4b4f-bd13-4b29-ad72-0794a3479dcd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:51.992554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4b4f-bd13-4b29-ad72-0794a3479dcd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:51.992833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4b4f-bd13-4b29-ad72-0794a3479dcd None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:51.994796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc4b4f-bd13-4b29-ad72-0794a3479dcd None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:51.996287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc4b4f-bd13-4b29-ad72-0794a3479dcd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:51.998048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 89/175] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:51 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:51.999276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8dcc-c795-4d05-8357-20d01561b1ed None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.001963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8dcc-c795-4d05-8357-20d01561b1ed None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.002291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8dcc-c795-4d05-8357-20d01561b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.041006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-559e8dcc-c795-4d05-8357-20d01561b1ed None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:52.046061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-559e8dcc-c795-4d05-8357-20d01561b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:52.139303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 90/176] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:52.140543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8dcc-c795-4d05-8357-20d01561b1ed None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:52.146774 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0927be-45bf-45b7-84ef-f79c37c0cc9a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:52.225502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9f64d-c6d9-4cba-ba64-84762ac7081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:52.226991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9f64d-c6d9-4cba-ba64-84762ac7081a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.227403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9f64d-c6d9-4cba-ba64-84762ac7081a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.227844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9f64d-c6d9-4cba-ba64-84762ac7081a None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.228737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9f64d-c6d9-4cba-ba64-84762ac7081a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:52.229199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9f64d-c6d9-4cba-ba64-84762ac7081a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:52.230827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9f64d-c6d9-4cba-ba64-84762ac7081a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:52.249189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 87/177] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:10:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:52.249507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8dcc-c795-4d05-8357-20d01561b1ed None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:52.250311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9f64d-c6d9-4cba-ba64-84762ac7081a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:52.289539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25896ae6-4123-4f0f-b463-91de81dd3bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:52.291522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896ae6-4123-4f0f-b463-91de81dd3bcf None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.292087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896ae6-4123-4f0f-b463-91de81dd3bcf None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.292846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896ae6-4123-4f0f-b463-91de81dd3bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.295353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25896ae6-4123-4f0f-b463-91de81dd3bcf None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=55d0918683154136b5f35d663a2df767, user.id=fd873144a6ac489d9c499e77ba96e536) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:52.295889 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25896ae6-4123-4f0f-b463-91de81dd3bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:52.299458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25896ae6-4123-4f0f-b463-91de81dd3bcf None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:52.311527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 91/178] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:52 2022] GET /identity/v3/role_assignments?user.id=fd873144a6ac489d9c499e77ba96e536&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:52.312907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25896ae6-4123-4f0f-b463-91de81dd3bcf None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:52.443541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25896ae6-4123-4f0f-b463-91de81dd3bcf None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:52.487278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeff31-3f78-4990-a224-b5162b1685f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:52.487603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9f64d-c6d9-4cba-ba64-84762ac7081a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:52.488856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeff31-3f78-4990-a224-b5162b1685f3 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.489494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeff31-3f78-4990-a224-b5162b1685f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.489616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeff31-3f78-4990-a224-b5162b1685f3 None admin] PATH_INFO: `/v3/users/62c6a5f644564d4ea81a8a00bc3dc990` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.494146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeff31-3f78-4990-a224-b5162b1685f3 None admin] RBAC: Authorizing `identity:get_user(user_id=62c6a5f644564d4ea81a8a00bc3dc990)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:52.494146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeff31-3f78-4990-a224-b5162b1685f3 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:52.495392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 92/179] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:52 2022] GET /identity/v3/users/62c6a5f644564d4ea81a8a00bc3dc990 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:52.497518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f1761-58c9-4c2e-9de7-464ed9d54230 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.497972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f1761-58c9-4c2e-9de7-464ed9d54230 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.498418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f1761-58c9-4c2e-9de7-464ed9d54230 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.500290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 93/180] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:52.501583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f1761-58c9-4c2e-9de7-464ed9d54230 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:52.571854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc19c75-ff3b-4b10-a09d-439f9df05ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:52.572681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc19c75-ff3b-4b10-a09d-439f9df05ee4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.572960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc19c75-ff3b-4b10-a09d-439f9df05ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.573233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc19c75-ff3b-4b10-a09d-439f9df05ee4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.603132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc19c75-ff3b-4b10-a09d-439f9df05ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:52.610696 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-0dc19c75-ff3b-4b10-a09d-439f9df05ee4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 17:10:52.612481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 88/181] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:52.613876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f32e-4034-4f3b-b947-777979aa595a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.618435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f32e-4034-4f3b-b947-777979aa595a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.618959 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f32e-4034-4f3b-b947-777979aa595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.628756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f1761-58c9-4c2e-9de7-464ed9d54230 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:52.643371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-8024f32e-4034-4f3b-b947-777979aa595a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:52.644771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8024f32e-4034-4f3b-b947-777979aa595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:52.664896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe04540-191b-4586-9e71-9920212f49d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:52.665871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04540-191b-4586-9e71-9920212f49d6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.666326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04540-191b-4586-9e71-9920212f49d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.666745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04540-191b-4586-9e71-9920212f49d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.724460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 89/182] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:52.725335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f32e-4034-4f3b-b947-777979aa595a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:52.738166 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe04540-191b-4586-9e71-9920212f49d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:52.739674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe04540-191b-4586-9e71-9920212f49d6 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:52.832811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f32e-4034-4f3b-b947-777979aa595a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:52.848718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 94/183] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:52.849580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe04540-191b-4586-9e71-9920212f49d6 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:52.878662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60060c-7082-483f-9eb1-869eaf319f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:52.879715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60060c-7082-483f-9eb1-869eaf319f6c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.880068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60060c-7082-483f-9eb1-869eaf319f6c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.880465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60060c-7082-483f-9eb1-869eaf319f6c None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.881433 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60060c-7082-483f-9eb1-869eaf319f6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:52.881904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60060c-7082-483f-9eb1-869eaf319f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:52.883678 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60060c-7082-483f-9eb1-869eaf319f6c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:52.892875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 90/184] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:52.899153 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4602ca-bcd3-41b9-9b84-603c596585d0 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.899447 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4602ca-bcd3-41b9-9b84-603c596585d0 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.899725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4602ca-bcd3-41b9-9b84-603c596585d0 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:52.901628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 91/185] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:52.902272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4602ca-bcd3-41b9-9b84-603c596585d0 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:52.958487 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe04540-191b-4586-9e71-9920212f49d6 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:52.991860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c9f46-44a0-4faf-aff5-f98f65a7bc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:52.992906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c9f46-44a0-4faf-aff5-f98f65a7bc27 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:52.993197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c9f46-44a0-4faf-aff5-f98f65a7bc27 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:52.993478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c9f46-44a0-4faf-aff5-f98f65a7bc27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.003234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c9f46-44a0-4faf-aff5-f98f65a7bc27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:53.009634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4602ca-bcd3-41b9-9b84-603c596585d0 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.010820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-957c9f46-44a0-4faf-aff5-f98f65a7bc27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:10:53.012035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 95/186] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:53.013209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64023e08-c9b2-4a03-89ae-10214d53d11e None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.013498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64023e08-c9b2-4a03-89ae-10214d53d11e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.013775 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64023e08-c9b2-4a03-89ae-10214d53d11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.031735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-64023e08-c9b2-4a03-89ae-10214d53d11e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:53.032913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-64023e08-c9b2-4a03-89ae-10214d53d11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:53.046007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b578f8-77e0-46be-a38a-bd168e21df2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.046921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b578f8-77e0-46be-a38a-bd168e21df2d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.047464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b578f8-77e0-46be-a38a-bd168e21df2d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.047748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b578f8-77e0-46be-a38a-bd168e21df2d None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.048945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b578f8-77e0-46be-a38a-bd168e21df2d None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:53.050420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b578f8-77e0-46be-a38a-bd168e21df2d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:53.052111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 92/187] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:52 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:53.052870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b578f8-77e0-46be-a38a-bd168e21df2d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.101509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 96/188] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:53.107041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64023e08-c9b2-4a03-89ae-10214d53d11e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.162330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b578f8-77e0-46be-a38a-bd168e21df2d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.194566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfeb4b-a867-4bc4-8428-61f08f8059d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.195941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfeb4b-a867-4bc4-8428-61f08f8059d2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.196218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfeb4b-a867-4bc4-8428-61f08f8059d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.196490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfeb4b-a867-4bc4-8428-61f08f8059d2 None admin] PATH_INFO: `/v3/users/3304ca1661ce470dbb2749289827ff07` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.197670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfeb4b-a867-4bc4-8428-61f08f8059d2 None admin] RBAC: Authorizing `identity:get_user(user_id=3304ca1661ce470dbb2749289827ff07)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:53.199159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfeb4b-a867-4bc4-8428-61f08f8059d2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:53.200776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 93/189] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/users/3304ca1661ce470dbb2749289827ff07 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:53.201510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfeb4b-a867-4bc4-8428-61f08f8059d2 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.205342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64023e08-c9b2-4a03-89ae-10214d53d11e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.237228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6adab4-1dec-4376-a984-c6aaca3f6522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.237899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6adab4-1dec-4376-a984-c6aaca3f6522 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.238217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6adab4-1dec-4376-a984-c6aaca3f6522 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.238495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6adab4-1dec-4376-a984-c6aaca3f6522 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.239234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6adab4-1dec-4376-a984-c6aaca3f6522 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:53.239540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6adab4-1dec-4376-a984-c6aaca3f6522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:53.240899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6adab4-1dec-4376-a984-c6aaca3f6522 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:53.248806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 97/190] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:53.249597 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6adab4-1dec-4376-a984-c6aaca3f6522 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.297414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfeb4b-a867-4bc4-8428-61f08f8059d2 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.329834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b995f3e-34d4-45c3-b037-3f5b9e7e084d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.330523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b995f3e-34d4-45c3-b037-3f5b9e7e084d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.330813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b995f3e-34d4-45c3-b037-3f5b9e7e084d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.331095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b995f3e-34d4-45c3-b037-3f5b9e7e084d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.331919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b995f3e-34d4-45c3-b037-3f5b9e7e084d None admin] RBAC: Adding query filter params (role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=55d0918683154136b5f35d663a2df767, user.id=62c6a5f644564d4ea81a8a00bc3dc990) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:53.332245 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b995f3e-34d4-45c3-b037-3f5b9e7e084d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:53.333655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b995f3e-34d4-45c3-b037-3f5b9e7e084d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:53.339754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 94/191] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/role_assignments?user.id=62c6a5f644564d4ea81a8a00bc3dc990&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:53.340994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa942eb4-d67b-4a99-9a12-d95c399bb6ae None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.341214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa942eb4-d67b-4a99-9a12-d95c399bb6ae None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.341494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa942eb4-d67b-4a99-9a12-d95c399bb6ae None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.343152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 95/192] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:53.347465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa942eb4-d67b-4a99-9a12-d95c399bb6ae None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.349128 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6adab4-1dec-4376-a984-c6aaca3f6522 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.387836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdd746-c6ed-43bc-a0bf-a1d3c6007818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.388667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdd746-c6ed-43bc-a0bf-a1d3c6007818 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.388950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdd746-c6ed-43bc-a0bf-a1d3c6007818 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.389233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdd746-c6ed-43bc-a0bf-a1d3c6007818 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.400479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdd746-c6ed-43bc-a0bf-a1d3c6007818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:53.408282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-01bdd746-c6ed-43bc-a0bf-a1d3c6007818 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:10:53.409560 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 98/193] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:53.410385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdd746-c6ed-43bc-a0bf-a1d3c6007818 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.464742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa942eb4-d67b-4a99-9a12-d95c399bb6ae None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.499823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e26e9-5dd6-493b-a198-47a81772c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.500405 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e26e9-5dd6-493b-a198-47a81772c361 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.500690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e26e9-5dd6-493b-a198-47a81772c361 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.501139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e26e9-5dd6-493b-a198-47a81772c361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.517247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdd746-c6ed-43bc-a0bf-a1d3c6007818 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.556310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137acf7-a82c-4dd3-9e64-d262a114f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.557190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137acf7-a82c-4dd3-9e64-d262a114f30e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.557832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137acf7-a82c-4dd3-9e64-d262a114f30e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.557832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137acf7-a82c-4dd3-9e64-d262a114f30e None admin] PATH_INFO: `/v3/users/fcb97f798332486993c5e7e0a5fe20c1` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.571982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137acf7-a82c-4dd3-9e64-d262a114f30e None admin] RBAC: Authorizing `identity:get_user(user_id=fcb97f798332486993c5e7e0a5fe20c1)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:53.573461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137acf7-a82c-4dd3-9e64-d262a114f30e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:53.573841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e26e9-5dd6-493b-a198-47a81772c361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:53.575346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e26e9-5dd6-493b-a198-47a81772c361 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:53.575464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 99/194] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/users/fcb97f798332486993c5e7e0a5fe20c1 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:53.576669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387055-a3db-4a14-bdd7-2f20a0b27f66 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.576946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387055-a3db-4a14-bdd7-2f20a0b27f66 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.577226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387055-a3db-4a14-bdd7-2f20a0b27f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.594282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8c387055-a3db-4a14-bdd7-2f20a0b27f66 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:53.595560 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8c387055-a3db-4a14-bdd7-2f20a0b27f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:53.657530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 100/195] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:53.658382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c387055-a3db-4a14-bdd7-2f20a0b27f66 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.673234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 96/196] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:53.674078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e26e9-5dd6-493b-a198-47a81772c361 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.751187 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c387055-a3db-4a14-bdd7-2f20a0b27f66 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.765989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e26e9-5dd6-493b-a198-47a81772c361 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.781866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bd083-75ca-4faf-af84-88f2e8c18fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.782563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bd083-75ca-4faf-af84-88f2e8c18fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.782846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bd083-75ca-4faf-af84-88f2e8c18fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.783121 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bd083-75ca-4faf-af84-88f2e8c18fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.783864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bd083-75ca-4faf-af84-88f2e8c18fa8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:53.784169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bd083-75ca-4faf-af84-88f2e8c18fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:53.785534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bd083-75ca-4faf-af84-88f2e8c18fa8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:53.793687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 101/197] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:53.798502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bd083-75ca-4faf-af84-88f2e8c18fa8 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.799643 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1167-6fc5-4854-8767-8458787d2d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.800285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1167-6fc5-4854-8767-8458787d2d98 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.800571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1167-6fc5-4854-8767-8458787d2d98 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.800843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1167-6fc5-4854-8767-8458787d2d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.865444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a1167-6fc5-4854-8767-8458787d2d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:53.867617 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a1167-6fc5-4854-8767-8458787d2d98 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:53.890409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bd083-75ca-4faf-af84-88f2e8c18fa8 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:53.923885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35881fc1-d584-4d07-9e85-d57770c8c708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:53.924741 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35881fc1-d584-4d07-9e85-d57770c8c708 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:53.925027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35881fc1-d584-4d07-9e85-d57770c8c708 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:53.925299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35881fc1-d584-4d07-9e85-d57770c8c708 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:53.926512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35881fc1-d584-4d07-9e85-d57770c8c708 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:53.927959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35881fc1-d584-4d07-9e85-d57770c8c708 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:53.930419 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 102/198] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:53.931049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35881fc1-d584-4d07-9e85-d57770c8c708 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:53.964824 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 97/199] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:53.964824 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1167-6fc5-4854-8767-8458787d2d98 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:54.024318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35881fc1-d584-4d07-9e85-d57770c8c708 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:54.056518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae76c4-0907-4abe-b92f-d7f4ae67ccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:54.057315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae76c4-0907-4abe-b92f-d7f4ae67ccf7 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:54.057601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae76c4-0907-4abe-b92f-d7f4ae67ccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:54.057878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae76c4-0907-4abe-b92f-d7f4ae67ccf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:54.058820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1167-6fc5-4854-8767-8458787d2d98 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:54.059249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae76c4-0907-4abe-b92f-d7f4ae67ccf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:54.060545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae76c4-0907-4abe-b92f-d7f4ae67ccf7 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:54.062169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 103/200] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:54.062926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae76c4-0907-4abe-b92f-d7f4ae67ccf7 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:54.090461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb6f0a-2c61-4f4d-bc00-f37eb3c74d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:54.091329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb6f0a-2c61-4f4d-bc00-f37eb3c74d91 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:54.091617 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb6f0a-2c61-4f4d-bc00-f37eb3c74d91 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:54.091890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb6f0a-2c61-4f4d-bc00-f37eb3c74d91 None admin] PATH_INFO: `/v3/users/fcb97f798332486993c5e7e0a5fe20c1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:54.093081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb6f0a-2c61-4f4d-bc00-f37eb3c74d91 None admin] RBAC: Authorizing `identity:get_user(user_id=fcb97f798332486993c5e7e0a5fe20c1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:54.094555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb6f0a-2c61-4f4d-bc00-f37eb3c74d91 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:54.096150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 98/201] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:53 2022] GET /identity/v3/users/fcb97f798332486993c5e7e0a5fe20c1 => generated 283 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:54.096900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb6f0a-2c61-4f4d-bc00-f37eb3c74d91 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:54.156943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae76c4-0907-4abe-b92f-d7f4ae67ccf7 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:54.189829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cf1dc-1a83-4ae2-b000-45b7dda2cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:54.190526 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cf1dc-1a83-4ae2-b000-45b7dda2cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:54.190810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cf1dc-1a83-4ae2-b000-45b7dda2cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:54.191086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cf1dc-1a83-4ae2-b000-45b7dda2cdb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:54.191911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cf1dc-1a83-4ae2-b000-45b7dda2cdb4 None admin] RBAC: Adding query filter params (role.id=d81e3775c6c34914af06f7580faa79bf, scope.project.id=55d0918683154136b5f35d663a2df767, user.id=3304ca1661ce470dbb2749289827ff07) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:54.192228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cf1dc-1a83-4ae2-b000-45b7dda2cdb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:54.193649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cf1dc-1a83-4ae2-b000-45b7dda2cdb4 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:54.199185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 104/202] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:54 2022] GET /identity/v3/role_assignments?user.id=3304ca1661ce470dbb2749289827ff07&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=d81e3775c6c34914af06f7580faa79bf => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:54.200023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cf1dc-1a83-4ae2-b000-45b7dda2cdb4 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:54.202148 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb6f0a-2c61-4f4d-bc00-f37eb3c74d91 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:54.238559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90528f8-12ff-40db-87af-e8a54caba8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:54.239444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90528f8-12ff-40db-87af-e8a54caba8e1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:54.239734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90528f8-12ff-40db-87af-e8a54caba8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:54.240015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90528f8-12ff-40db-87af-e8a54caba8e1 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:54.241294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90528f8-12ff-40db-87af-e8a54caba8e1 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:54.242861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90528f8-12ff-40db-87af-e8a54caba8e1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:54.244640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 99/203] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:54 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:54.245433 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90528f8-12ff-40db-87af-e8a54caba8e1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:54.340548 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cf1dc-1a83-4ae2-b000-45b7dda2cdb4 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:54.350706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90528f8-12ff-40db-87af-e8a54caba8e1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:54.379846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d8069-26c1-4ecd-aed8-7408b252e7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:54.380784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8069-26c1-4ecd-aed8-7408b252e7e0 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:54.381195 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8069-26c1-4ecd-aed8-7408b252e7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:54.381607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8069-26c1-4ecd-aed8-7408b252e7e0 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:54.382563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d8069-26c1-4ecd-aed8-7408b252e7e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:54.383990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d8069-26c1-4ecd-aed8-7408b252e7e0 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:54.386944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366c77b-5254-43ed-8ad0-a83b47fd33c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:54.387602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366c77b-5254-43ed-8ad0-a83b47fd33c7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:54.387890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366c77b-5254-43ed-8ad0-a83b47fd33c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:54.388172 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366c77b-5254-43ed-8ad0-a83b47fd33c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:54.405650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 105/204] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:10:54 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:54.411118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d8069-26c1-4ecd-aed8-7408b252e7e0 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:54.474476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366c77b-5254-43ed-8ad0-a83b47fd33c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:54.480975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366c77b-5254-43ed-8ad0-a83b47fd33c7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:54.553395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d8069-26c1-4ecd-aed8-7408b252e7e0 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:54.587833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 100/205] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:54.588996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0450448-e564-430a-b419-2f15ffcf6217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:54.589916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0450448-e564-430a-b419-2f15ffcf6217 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:54.590433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0450448-e564-430a-b419-2f15ffcf6217 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:54.590910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0450448-e564-430a-b419-2f15ffcf6217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:54.591960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0450448-e564-430a-b419-2f15ffcf6217 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080, user.id=fcb97f798332486993c5e7e0a5fe20c1) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:54.592519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0450448-e564-430a-b419-2f15ffcf6217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:54.593213 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366c77b-5254-43ed-8ad0-a83b47fd33c7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:54.593978 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0450448-e564-430a-b419-2f15ffcf6217 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:54.602242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 106/206] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:54 2022] GET /identity/v3/role_assignments?user.id=fcb97f798332486993c5e7e0a5fe20c1&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:54.706279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366c77b-5254-43ed-8ad0-a83b47fd33c7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:54.746346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7183b8c-c521-42e0-8f51-e249c49cace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:54.747239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183b8c-c521-42e0-8f51-e249c49cace7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:54.747527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183b8c-c521-42e0-8f51-e249c49cace7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:54.747809 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183b8c-c521-42e0-8f51-e249c49cace7 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:54.749092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7183b8c-c521-42e0-8f51-e249c49cace7 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:54.750640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7183b8c-c521-42e0-8f51-e249c49cace7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:54.752793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 101/207] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:54 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:54.758983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0450448-e564-430a-b419-2f15ffcf6217 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:54.870869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0450448-e564-430a-b419-2f15ffcf6217 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:54.904305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af62a06-b0b8-4868-b28f-ec7e29d778d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:54.905020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af62a06-b0b8-4868-b28f-ec7e29d778d5 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:54.905255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af62a06-b0b8-4868-b28f-ec7e29d778d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:54.905534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af62a06-b0b8-4868-b28f-ec7e29d778d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:54.906392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af62a06-b0b8-4868-b28f-ec7e29d778d5 None admin] RBAC: Adding query filter params (role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080, user.id=fcb97f798332486993c5e7e0a5fe20c1) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:54.906711 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af62a06-b0b8-4868-b28f-ec7e29d778d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:54.908140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af62a06-b0b8-4868-b28f-ec7e29d778d5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:54.914141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 107/208] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:54 2022] GET /identity/v3/role_assignments?user.id=fcb97f798332486993c5e7e0a5fe20c1&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:56.890471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ff06-db95-4177-9aa8-c7ff7f6fd202 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:56.891008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ff06-db95-4177-9aa8-c7ff7f6fd202 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:56.891008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ff06-db95-4177-9aa8-c7ff7f6fd202 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:56.892791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 102/209] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:56.897991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603ec11-6c25-473c-83d4-6d4ef80c44c2 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:56.898406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603ec11-6c25-473c-83d4-6d4ef80c44c2 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:56.898594 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603ec11-6c25-473c-83d4-6d4ef80c44c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:56.915905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0603ec11-6c25-473c-83d4-6d4ef80c44c2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:56.917090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0603ec11-6c25-473c-83d4-6d4ef80c44c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:56.921989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abfe3b-9d4a-4298-8cf1-9d017137c428 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:56.922571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abfe3b-9d4a-4298-8cf1-9d017137c428 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:56.922853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abfe3b-9d4a-4298-8cf1-9d017137c428 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:56.924850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 103/210] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:56.930532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c468e6-0cd3-4bb5-976f-cd21f6277c93 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:56.930820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c468e6-0cd3-4bb5-976f-cd21f6277c93 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:56.931096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c468e6-0cd3-4bb5-976f-cd21f6277c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:56.948757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-00c468e6-0cd3-4bb5-976f-cd21f6277c93 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:56.950274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-00c468e6-0cd3-4bb5-976f-cd21f6277c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:56.984470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 108/211] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:56.985778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e5b6d-36d1-4f98-9571-8c732aea22eb None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:56.986065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e5b6d-36d1-4f98-9571-8c732aea22eb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:56.990457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e5b6d-36d1-4f98-9571-8c732aea22eb None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:56.993038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 109/212] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:56.999049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc42c9-61d9-4f01-93da-a2c26cf158a0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:56.999460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc42c9-61d9-4f01-93da-a2c26cf158a0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:56.999748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc42c9-61d9-4f01-93da-a2c26cf158a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.020057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a2cc42c9-61d9-4f01-93da-a2c26cf158a0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:57.020633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 104/213] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:10:57.021318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a2cc42c9-61d9-4f01-93da-a2c26cf158a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:57.021501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c468e6-0cd3-4bb5-976f-cd21f6277c93 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.089778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 110/214] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:57.090660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc42c9-61d9-4f01-93da-a2c26cf158a0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.131177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c468e6-0cd3-4bb5-976f-cd21f6277c93 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.164496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51f12-5e14-4ad9-b026-cde06e3afc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.165560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51f12-5e14-4ad9-b026-cde06e3afc4e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.165920 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51f12-5e14-4ad9-b026-cde06e3afc4e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.166232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51f12-5e14-4ad9-b026-cde06e3afc4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.176631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb51f12-5e14-4ad9-b026-cde06e3afc4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:57.183620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-fbb51f12-5e14-4ad9-b026-cde06e3afc4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:10:57.189366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 105/215] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:57.189366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51f12-5e14-4ad9-b026-cde06e3afc4e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.193374 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc42c9-61d9-4f01-93da-a2c26cf158a0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.225853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8716f2b-3eb2-4053-846c-f5d377544c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.227246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716f2b-3eb2-4053-846c-f5d377544c57 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.227529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716f2b-3eb2-4053-846c-f5d377544c57 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.227801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716f2b-3eb2-4053-846c-f5d377544c57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.237754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8716f2b-3eb2-4053-846c-f5d377544c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:57.244682 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-f8716f2b-3eb2-4053-846c-f5d377544c57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:10:57.246006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 111/216] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:57.246662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8716f2b-3eb2-4053-846c-f5d377544c57 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.283632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51f12-5e14-4ad9-b026-cde06e3afc4e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.316427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bdfe8-13ac-4841-ac54-339033b31d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.317217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bdfe8-13ac-4841-ac54-339033b31d98 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.317505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bdfe8-13ac-4841-ac54-339033b31d98 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.317776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bdfe8-13ac-4841-ac54-339033b31d98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.318979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bdfe8-13ac-4841-ac54-339033b31d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:57.320458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bdfe8-13ac-4841-ac54-339033b31d98 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:57.322046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 106/217] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:57.323236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59742ab9-bf98-4ca3-b03f-9ceffbc3d290 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.323519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59742ab9-bf98-4ca3-b03f-9ceffbc3d290 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.323795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59742ab9-bf98-4ca3-b03f-9ceffbc3d290 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.325412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 107/218] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:10:57.326121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59742ab9-bf98-4ca3-b03f-9ceffbc3d290 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.341886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8716f2b-3eb2-4053-846c-f5d377544c57 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.372848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5259-6ae3-471b-a608-12ac963c26ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.373511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5259-6ae3-471b-a608-12ac963c26ad None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.373804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5259-6ae3-471b-a608-12ac963c26ad None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.374082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5259-6ae3-471b-a608-12ac963c26ad None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.374848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb5259-6ae3-471b-a608-12ac963c26ad None admin] RBAC: Adding query filter params (name=member) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:57.375154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb5259-6ae3-471b-a608-12ac963c26ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:57.376517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb5259-6ae3-471b-a608-12ac963c26ad None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:57.384261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 112/219] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:57.384859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5259-6ae3-471b-a608-12ac963c26ad None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.422707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59742ab9-bf98-4ca3-b03f-9ceffbc3d290 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.453293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4b026-1dbb-4116-bfa0-565b239ec38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.453952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4b026-1dbb-4116-bfa0-565b239ec38b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.454270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4b026-1dbb-4116-bfa0-565b239ec38b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.454548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4b026-1dbb-4116-bfa0-565b239ec38b None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.455289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4b026-1dbb-4116-bfa0-565b239ec38b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:57.455597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4b026-1dbb-4116-bfa0-565b239ec38b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:57.456954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4b026-1dbb-4116-bfa0-565b239ec38b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:57.465101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 108/220] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:57.466266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0411f-fcf7-4c0b-a289-9e4b1dcf8a48 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.466554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0411f-fcf7-4c0b-a289-9e4b1dcf8a48 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.466829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0411f-fcf7-4c0b-a289-9e4b1dcf8a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.477996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5259-6ae3-471b-a608-12ac963c26ad None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.484079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-edd0411f-fcf7-4c0b-a289-9e4b1dcf8a48 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:10:57.485239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-edd0411f-fcf7-4c0b-a289-9e4b1dcf8a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:10:57.509569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b674a8-feb4-4761-96fc-ab39a2fc07eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.510273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b674a8-feb4-4761-96fc-ab39a2fc07eb None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.510563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b674a8-feb4-4761-96fc-ab39a2fc07eb None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.510843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b674a8-feb4-4761-96fc-ab39a2fc07eb None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.511547 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b674a8-feb4-4761-96fc-ab39a2fc07eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:57.512985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b674a8-feb4-4761-96fc-ab39a2fc07eb None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:57.532676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 113/221] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:10:57 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:10:57.533475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b674a8-feb4-4761-96fc-ab39a2fc07eb None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.566133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 109/222] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:10:57.566133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0411f-fcf7-4c0b-a289-9e4b1dcf8a48 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.655679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b674a8-feb4-4761-96fc-ab39a2fc07eb None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.664183 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0411f-fcf7-4c0b-a289-9e4b1dcf8a48 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.689684 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2951-d8d1-4bd9-89ca-c4fda4c71259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.690524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2951-d8d1-4bd9-89ca-c4fda4c71259 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.690811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2951-d8d1-4bd9-89ca-c4fda4c71259 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.691092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2951-d8d1-4bd9-89ca-c4fda4c71259 None admin] PATH_INFO: `/v3/users/9ef0ab0c618041b19c5bd120aa39fe68` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.699933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96a9c4-0567-425a-aa66-462a310dd032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.700815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96a9c4-0567-425a-aa66-462a310dd032 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.701097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96a9c4-0567-425a-aa66-462a310dd032 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.701374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96a9c4-0567-425a-aa66-462a310dd032 None admin] PATH_INFO: `/v3/users/fcb97f798332486993c5e7e0a5fe20c1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.702652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96a9c4-0567-425a-aa66-462a310dd032 None admin] RBAC: Authorizing `identity:get_user(user_id=fcb97f798332486993c5e7e0a5fe20c1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:57.704111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96a9c4-0567-425a-aa66-462a310dd032 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:57.710083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 110/223] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/users/fcb97f798332486993c5e7e0a5fe20c1 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:57.710361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b2951-d8d1-4bd9-89ca-c4fda4c71259 None admin] RBAC: Authorizing `identity:get_user(user_id=9ef0ab0c618041b19c5bd120aa39fe68)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:57.711037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96a9c4-0567-425a-aa66-462a310dd032 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.711119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b2951-d8d1-4bd9-89ca-c4fda4c71259 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:57.715178 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 114/224] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/users/9ef0ab0c618041b19c5bd120aa39fe68 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:57.715770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2951-d8d1-4bd9-89ca-c4fda4c71259 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.818043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2951-d8d1-4bd9-89ca-c4fda4c71259 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.829107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96a9c4-0567-425a-aa66-462a310dd032 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:57.857815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2112862-21dd-4295-9d36-ffefdae85935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.858722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2112862-21dd-4295-9d36-ffefdae85935 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.859070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2112862-21dd-4295-9d36-ffefdae85935 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.859295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2112862-21dd-4295-9d36-ffefdae85935 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.860485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2112862-21dd-4295-9d36-ffefdae85935 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:57.861939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2112862-21dd-4295-9d36-ffefdae85935 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:57.864012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 115/225] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:57.864800 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2112862-21dd-4295-9d36-ffefdae85935 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.873087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc435-622b-4607-9e83-205ea5bdac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:57.873916 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc435-622b-4607-9e83-205ea5bdac2a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:57.874260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc435-622b-4607-9e83-205ea5bdac2a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:57.874536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc435-622b-4607-9e83-205ea5bdac2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:57.888878 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdc435-622b-4607-9e83-205ea5bdac2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:10:57.896600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-68fdc435-622b-4607-9e83-205ea5bdac2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:10:57.898836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 111/226] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:10:57.899813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc435-622b-4607-9e83-205ea5bdac2a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:57.967038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2112862-21dd-4295-9d36-ffefdae85935 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:58.000854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2616fc-c5dd-4210-8300-2f7c170e225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:58.001511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2616fc-c5dd-4210-8300-2f7c170e225c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:58.001794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2616fc-c5dd-4210-8300-2f7c170e225c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:58.002053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc435-622b-4607-9e83-205ea5bdac2a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:58.002172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2616fc-c5dd-4210-8300-2f7c170e225c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:58.036589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189afee-8b57-4544-80eb-2cd6026ecaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:58.037483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189afee-8b57-4544-80eb-2cd6026ecaa6 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:58.037763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189afee-8b57-4544-80eb-2cd6026ecaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:58.038037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189afee-8b57-4544-80eb-2cd6026ecaa6 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/users/fcb97f798332486993c5e7e0a5fe20c1/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:58.040194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189afee-8b57-4544-80eb-2cd6026ecaa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080, user_id=fcb97f798332486993c5e7e0a5fe20c1, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:58.041646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189afee-8b57-4544-80eb-2cd6026ecaa6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:58.057007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 112/227] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:10:57 2022] PUT /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/users/fcb97f798332486993c5e7e0a5fe20c1/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:10:58.057844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189afee-8b57-4544-80eb-2cd6026ecaa6 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:58.076953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2616fc-c5dd-4210-8300-2f7c170e225c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:58.078948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2616fc-c5dd-4210-8300-2f7c170e225c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:58.167222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189afee-8b57-4544-80eb-2cd6026ecaa6 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:58.185120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 116/228] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:10:58.190819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2616fc-c5dd-4210-8300-2f7c170e225c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:58.216929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68768a2-3b43-418a-a66b-403e5310efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:58.217662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68768a2-3b43-418a-a66b-403e5310efb0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:58.217892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68768a2-3b43-418a-a66b-403e5310efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:58.218199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68768a2-3b43-418a-a66b-403e5310efb0 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:58.218957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68768a2-3b43-418a-a66b-403e5310efb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:58.219263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68768a2-3b43-418a-a66b-403e5310efb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:58.220709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68768a2-3b43-418a-a66b-403e5310efb0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:58.235534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 113/229] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:10:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:58.241053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68768a2-3b43-418a-a66b-403e5310efb0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:58.293175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2616fc-c5dd-4210-8300-2f7c170e225c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:58.376779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68768a2-3b43-418a-a66b-403e5310efb0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:58.387709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48114788-6b1e-4b4b-ac82-b00bb77ea225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:58.388592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48114788-6b1e-4b4b-ac82-b00bb77ea225 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:58.388873 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48114788-6b1e-4b4b-ac82-b00bb77ea225 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:58.389148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48114788-6b1e-4b4b-ac82-b00bb77ea225 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:58.390923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48114788-6b1e-4b4b-ac82-b00bb77ea225 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:58.392398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48114788-6b1e-4b4b-ac82-b00bb77ea225 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:58.394321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 117/230] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:58 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:58.400818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48114788-6b1e-4b4b-ac82-b00bb77ea225 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:58.421888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2019b7-154f-4636-a073-e7c6d0abce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:58.423085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2019b7-154f-4636-a073-e7c6d0abce71 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:58.423365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2019b7-154f-4636-a073-e7c6d0abce71 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:58.423640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2019b7-154f-4636-a073-e7c6d0abce71 None admin] PATH_INFO: `/v3/users/fcb97f798332486993c5e7e0a5fe20c1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:58.424877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2019b7-154f-4636-a073-e7c6d0abce71 None admin] RBAC: Authorizing `identity:get_user(user_id=fcb97f798332486993c5e7e0a5fe20c1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:58.426366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2019b7-154f-4636-a073-e7c6d0abce71 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:58.430602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 114/231] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:10:58 2022] GET /identity/v3/users/fcb97f798332486993c5e7e0a5fe20c1 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:58.435480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2019b7-154f-4636-a073-e7c6d0abce71 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:58.509348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48114788-6b1e-4b4b-ac82-b00bb77ea225 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:58.555224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2019b7-154f-4636-a073-e7c6d0abce71 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:58.567858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10174e9b-1ac0-4086-a9c4-0c2a8465b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:58.568927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10174e9b-1ac0-4086-a9c4-0c2a8465b88d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:58.569043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10174e9b-1ac0-4086-a9c4-0c2a8465b88d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:58.569442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10174e9b-1ac0-4086-a9c4-0c2a8465b88d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:58.570461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10174e9b-1ac0-4086-a9c4-0c2a8465b88d None admin] RBAC: Adding query filter params (role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080, user.id=9ef0ab0c618041b19c5bd120aa39fe68) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:10:58.570879 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10174e9b-1ac0-4086-a9c4-0c2a8465b88d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:58.572436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10174e9b-1ac0-4086-a9c4-0c2a8465b88d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:58.578688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 118/232] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:10:58 2022] GET /identity/v3/role_assignments?user.id=9ef0ab0c618041b19c5bd120aa39fe68&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=43e227d04ba64588acce441d98a394f3 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:10:58.617566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5ea39-a634-46d8-ad4d-d6beef8cf279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:58.618506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ea39-a634-46d8-ad4d-d6beef8cf279 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:58.618787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ea39-a634-46d8-ad4d-d6beef8cf279 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:58.619061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ea39-a634-46d8-ad4d-d6beef8cf279 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:58.622985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5ea39-a634-46d8-ad4d-d6beef8cf279 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:58.624591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5ea39-a634-46d8-ad4d-d6beef8cf279 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:58.626549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 115/233] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:10:58 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:10:58.632743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10174e9b-1ac0-4086-a9c4-0c2a8465b88d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:10:58.779453 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10174e9b-1ac0-4086-a9c4-0c2a8465b88d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:10:58.826324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283ff0c-a6ca-44d3-8ee3-b38c13fc93ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:10:58.827215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ff0c-a6ca-44d3-8ee3-b38c13fc93ec None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:10:58.827493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ff0c-a6ca-44d3-8ee3-b38c13fc93ec None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:10:58.827764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ff0c-a6ca-44d3-8ee3-b38c13fc93ec None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/users/fcb97f798332486993c5e7e0a5fe20c1/roles/59b67f94d2af48b08b7bef41a8396bfb` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:10:58.829973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283ff0c-a6ca-44d3-8ee3-b38c13fc93ec None admin] RBAC: Authorizing `identity:create_grant(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080, user_id=fcb97f798332486993c5e7e0a5fe20c1, role_id=59b67f94d2af48b08b7bef41a8396bfb)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:10:58.831491 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283ff0c-a6ca-44d3-8ee3-b38c13fc93ec None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:10:58.845607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 119/234] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:10:58 2022] PUT /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/users/fcb97f798332486993c5e7e0a5fe20c1/roles/59b67f94d2af48b08b7bef41a8396bfb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:00.518660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608578fa-4326-4153-8c83-bf4b74107fd9 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:00.519169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608578fa-4326-4153-8c83-bf4b74107fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:00.519240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608578fa-4326-4153-8c83-bf4b74107fd9 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:00.521441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 116/235] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:00.527987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dddd1-b154-4bb5-8d44-fd868a2a0524 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:00.528512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dddd1-b154-4bb5-8d44-fd868a2a0524 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:00.528586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dddd1-b154-4bb5-8d44-fd868a2a0524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:00.546470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4b0dddd1-b154-4bb5-8d44-fd868a2a0524 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:00.547951 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4b0dddd1-b154-4bb5-8d44-fd868a2a0524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:00.624423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 120/236] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:00.650561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608578fa-4326-4153-8c83-bf4b74107fd9 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:00.754421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608578fa-4326-4153-8c83-bf4b74107fd9 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:00.788534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03043fd-b1ab-4abe-a983-7d834961753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:00.789336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03043fd-b1ab-4abe-a983-7d834961753e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:00.789623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03043fd-b1ab-4abe-a983-7d834961753e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:00.789905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03043fd-b1ab-4abe-a983-7d834961753e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:00.791107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03043fd-b1ab-4abe-a983-7d834961753e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:00.792567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03043fd-b1ab-4abe-a983-7d834961753e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:00.795136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309d43-648f-4fd1-b344-e2e563d17ce9 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:00.795254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 117/237] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:00.799722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309d43-648f-4fd1-b344-e2e563d17ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:00.800024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309d43-648f-4fd1-b344-e2e563d17ce9 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:00.802094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 121/238] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:00.803457 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03043fd-b1ab-4abe-a983-7d834961753e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:00.809511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c49043-96e4-4826-9f40-d5e7110f0c23 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:00.810059 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c49043-96e4-4826-9f40-d5e7110f0c23 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:00.810585 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c49043-96e4-4826-9f40-d5e7110f0c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:00.841044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-65c49043-96e4-4826-9f40-d5e7110f0c23 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:00.855739 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-65c49043-96e4-4826-9f40-d5e7110f0c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:00.942235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 122/239] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:00.943923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419442d-5439-41b2-9171-60f6c9bb3ce7 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:00.944435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419442d-5439-41b2-9171-60f6c9bb3ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:00.945545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419442d-5439-41b2-9171-60f6c9bb3ce7 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:00.947636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 123/240] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:00.955736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ed1b2-cc6d-4a1f-bc4f-68fca9c8bc59 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:00.956261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ed1b2-cc6d-4a1f-bc4f-68fca9c8bc59 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:00.956763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ed1b2-cc6d-4a1f-bc4f-68fca9c8bc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:00.974338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-6f7ed1b2-cc6d-4a1f-bc4f-68fca9c8bc59 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:00.975875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6f7ed1b2-cc6d-4a1f-bc4f-68fca9c8bc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:01.050835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 124/241] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:01.056138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ed1b2-cc6d-4a1f-bc4f-68fca9c8bc59 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:01.126339 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03043fd-b1ab-4abe-a983-7d834961753e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.160621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1b94d-e987-4051-b4dc-7e36d6ce211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.161632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b94d-e987-4051-b4dc-7e36d6ce211b None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.162146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b94d-e987-4051-b4dc-7e36d6ce211b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.162628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b94d-e987-4051-b4dc-7e36d6ce211b None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.163586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1b94d-e987-4051-b4dc-7e36d6ce211b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:01.165261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1b94d-e987-4051-b4dc-7e36d6ce211b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:01.167461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ed1b2-cc6d-4a1f-bc4f-68fca9c8bc59 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.197460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 118/242] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:11:00 2022] POST /identity/v3/users => generated 293 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:11:01.197460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1b94d-e987-4051-b4dc-7e36d6ce211b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:01.230578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b69285-c0f5-46bc-a072-4ea7da2d23f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.231399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b69285-c0f5-46bc-a072-4ea7da2d23f6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.231686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b69285-c0f5-46bc-a072-4ea7da2d23f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.231962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b69285-c0f5-46bc-a072-4ea7da2d23f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.249112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b69285-c0f5-46bc-a072-4ea7da2d23f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:01.256502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-27b69285-c0f5-46bc-a072-4ea7da2d23f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 17:11:01.258061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 125/243] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:01.259387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0786ad0-8ccb-4f43-9e6c-36e536497cb0 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.259673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0786ad0-8ccb-4f43-9e6c-36e536497cb0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.259948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0786ad0-8ccb-4f43-9e6c-36e536497cb0 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.261957 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 126/244] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:01.263312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0786ad0-8ccb-4f43-9e6c-36e536497cb0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:01.347161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1b94d-e987-4051-b4dc-7e36d6ce211b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.396440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0786ad0-8ccb-4f43-9e6c-36e536497cb0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.409295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8c244-9ef7-466b-9503-cdfd95a05d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.410130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c244-9ef7-466b-9503-cdfd95a05d8a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.410408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c244-9ef7-466b-9503-cdfd95a05d8a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.410680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c244-9ef7-466b-9503-cdfd95a05d8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.428352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8c244-9ef7-466b-9503-cdfd95a05d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:01.437593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-e7d8c244-9ef7-466b-9503-cdfd95a05d8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:11:01.438850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 119/245] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:01.440160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f8e0d-bb98-46f7-8fdf-98ca1f6e3475 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.440451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f8e0d-bb98-46f7-8fdf-98ca1f6e3475 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.440731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f8e0d-bb98-46f7-8fdf-98ca1f6e3475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.443392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3981cb-440f-450a-b46f-5ce28749d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.444094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3981cb-440f-450a-b46f-5ce28749d268 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.444470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3981cb-440f-450a-b46f-5ce28749d268 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.444788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3981cb-440f-450a-b46f-5ce28749d268 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.445717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3981cb-440f-450a-b46f-5ce28749d268 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:01.445900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3981cb-440f-450a-b46f-5ce28749d268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:01.448159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3981cb-440f-450a-b46f-5ce28749d268 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:01.458611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-658f8e0d-bb98-46f7-8fdf-98ca1f6e3475 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:01.459930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-658f8e0d-bb98-46f7-8fdf-98ca1f6e3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:01.462366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 127/246] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:01.463602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3981cb-440f-450a-b46f-5ce28749d268 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:01.536084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 120/247] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:01.537738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f8e0d-bb98-46f7-8fdf-98ca1f6e3475 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:01.589228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3981cb-440f-450a-b46f-5ce28749d268 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.624522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96c26f-6231-4036-ac01-4297f7fa18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.625635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96c26f-6231-4036-ac01-4297f7fa18c0 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.626154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96c26f-6231-4036-ac01-4297f7fa18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.626631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96c26f-6231-4036-ac01-4297f7fa18c0 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.627578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96c26f-6231-4036-ac01-4297f7fa18c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:01.628096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96c26f-6231-4036-ac01-4297f7fa18c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:01.629717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96c26f-6231-4036-ac01-4297f7fa18c0 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:01.640123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 128/248] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:01.640286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96c26f-6231-4036-ac01-4297f7fa18c0 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:01.663048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f8e0d-bb98-46f7-8fdf-98ca1f6e3475 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.701419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a45af7-4757-425f-a3e9-760ed340e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.702288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a45af7-4757-425f-a3e9-760ed340e80e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.702637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a45af7-4757-425f-a3e9-760ed340e80e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.702841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a45af7-4757-425f-a3e9-760ed340e80e None admin] PATH_INFO: `/v3/users/cdbb66ef26cc48c2a4d2ef21f90fad79` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.717800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a45af7-4757-425f-a3e9-760ed340e80e None admin] RBAC: Authorizing `identity:get_user(user_id=cdbb66ef26cc48c2a4d2ef21f90fad79)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:01.719298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a45af7-4757-425f-a3e9-760ed340e80e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:01.721282 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 121/249] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:01 2022] GET /identity/v3/users/cdbb66ef26cc48c2a4d2ef21f90fad79 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:01.722069 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a45af7-4757-425f-a3e9-760ed340e80e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:01.751690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96c26f-6231-4036-ac01-4297f7fa18c0 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.786507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af0204-f8f8-400c-99a9-e50868176f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.787763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af0204-f8f8-400c-99a9-e50868176f12 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.788262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af0204-f8f8-400c-99a9-e50868176f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.789327 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af0204-f8f8-400c-99a9-e50868176f12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.800812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af0204-f8f8-400c-99a9-e50868176f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:01.808356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-b2af0204-f8f8-400c-99a9-e50868176f12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:01.809857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 129/250] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:01.811038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af0204-f8f8-400c-99a9-e50868176f12 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:01.820854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a45af7-4757-425f-a3e9-760ed340e80e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.855304 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f2b91-89c0-40aa-bccb-98703a048a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.856176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f2b91-89c0-40aa-bccb-98703a048a04 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.856455 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f2b91-89c0-40aa-bccb-98703a048a04 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.856726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f2b91-89c0-40aa-bccb-98703a048a04 None admin] PATH_INFO: `/v3/users/fcb97f798332486993c5e7e0a5fe20c1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.857931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f2b91-89c0-40aa-bccb-98703a048a04 None admin] RBAC: Authorizing `identity:get_user(user_id=fcb97f798332486993c5e7e0a5fe20c1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:01.859402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f2b91-89c0-40aa-bccb-98703a048a04 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:01.861319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 122/251] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:01 2022] GET /identity/v3/users/fcb97f798332486993c5e7e0a5fe20c1 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:01.862078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f2b91-89c0-40aa-bccb-98703a048a04 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:01.916165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af0204-f8f8-400c-99a9-e50868176f12 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.950424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec3696-051e-4e72-af32-24ceb4f4fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.951542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec3696-051e-4e72-af32-24ceb4f4fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.952070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec3696-051e-4e72-af32-24ceb4f4fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.952558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec3696-051e-4e72-af32-24ceb4f4fbc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:01.964730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f2b91-89c0-40aa-bccb-98703a048a04 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:01.998438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91737dee-9a5d-4c17-93b2-b5aa8e4648b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:01.999106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737dee-9a5d-4c17-93b2-b5aa8e4648b9 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:01.999393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737dee-9a5d-4c17-93b2-b5aa8e4648b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:01.999669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737dee-9a5d-4c17-93b2-b5aa8e4648b9 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.000417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91737dee-9a5d-4c17-93b2-b5aa8e4648b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:02.000722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91737dee-9a5d-4c17-93b2-b5aa8e4648b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:02.002100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91737dee-9a5d-4c17-93b2-b5aa8e4648b9 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:02.011114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 123/252] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:02.012147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91737dee-9a5d-4c17-93b2-b5aa8e4648b9 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:02.025359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec3696-051e-4e72-af32-24ceb4f4fbc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:02.027147 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec3696-051e-4e72-af32-24ceb4f4fbc1 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:02.110332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91737dee-9a5d-4c17-93b2-b5aa8e4648b9 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:02.125130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 130/253] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:02.126911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb6c4-1845-4cab-956d-f07a8a60b49e None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.127408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb6c4-1845-4cab-956d-f07a8a60b49e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.127903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb6c4-1845-4cab-956d-f07a8a60b49e None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.129896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 131/254] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:02.130889 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb6c4-1845-4cab-956d-f07a8a60b49e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:02.143742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c24038-3d82-46a4-b698-83d3830244aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:02.144391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c24038-3d82-46a4-b698-83d3830244aa None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.144675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c24038-3d82-46a4-b698-83d3830244aa None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.144950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c24038-3d82-46a4-b698-83d3830244aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.213186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c24038-3d82-46a4-b698-83d3830244aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:02.214588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c24038-3d82-46a4-b698-83d3830244aa None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:02.235655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb6c4-1845-4cab-956d-f07a8a60b49e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:02.270367 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7f23f-ffa3-4d4f-b78a-85a6d41b0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:02.271673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7f23f-ffa3-4d4f-b78a-85a6d41b0839 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.272157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7f23f-ffa3-4d4f-b78a-85a6d41b0839 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.272628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7f23f-ffa3-4d4f-b78a-85a6d41b0839 None admin] PATH_INFO: `/v3/users/9ef0ab0c618041b19c5bd120aa39fe68` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.274680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7f23f-ffa3-4d4f-b78a-85a6d41b0839 None admin] RBAC: Authorizing `identity:get_user(user_id=9ef0ab0c618041b19c5bd120aa39fe68)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:02.276365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7f23f-ffa3-4d4f-b78a-85a6d41b0839 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:02.278297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 132/255] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:02 2022] GET /identity/v3/users/9ef0ab0c618041b19c5bd120aa39fe68 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:02.279402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7f23f-ffa3-4d4f-b78a-85a6d41b0839 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:02.335018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 124/256] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:02.338568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397b24-cf18-4f05-9230-acf5215f8256 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.339065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397b24-cf18-4f05-9230-acf5215f8256 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.339645 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397b24-cf18-4f05-9230-acf5215f8256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.357210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a0397b24-cf18-4f05-9230-acf5215f8256 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:02.358461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a0397b24-cf18-4f05-9230-acf5215f8256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:02.398528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7f23f-ffa3-4d4f-b78a-85a6d41b0839 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:02.433014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78718c-5c66-48bc-a7c3-ceab3cea56b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:02.433880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78718c-5c66-48bc-a7c3-ceab3cea56b9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.434202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78718c-5c66-48bc-a7c3-ceab3cea56b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.435363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78718c-5c66-48bc-a7c3-ceab3cea56b9 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.439107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78718c-5c66-48bc-a7c3-ceab3cea56b9 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:02.440801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78718c-5c66-48bc-a7c3-ceab3cea56b9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:02.442524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 125/257] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:02.443795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397b24-cf18-4f05-9230-acf5215f8256 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:02.448149 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 133/258] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:02 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:02.449836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78718c-5c66-48bc-a7c3-ceab3cea56b9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:02.563305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78718c-5c66-48bc-a7c3-ceab3cea56b9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:02.569064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397b24-cf18-4f05-9230-acf5215f8256 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:02.605001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac523ef-c020-49a4-938e-db4883de8485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:02.605829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac523ef-c020-49a4-938e-db4883de8485 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.606131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac523ef-c020-49a4-938e-db4883de8485 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.606427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac523ef-c020-49a4-938e-db4883de8485 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.607673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac523ef-c020-49a4-938e-db4883de8485 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:02.609110 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac523ef-c020-49a4-938e-db4883de8485 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:02.611103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 134/259] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:02 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:02.611870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac523ef-c020-49a4-938e-db4883de8485 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:02.619386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585775-f3f8-4a73-92bb-dbb7c6fda083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:02.620568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585775-f3f8-4a73-92bb-dbb7c6fda083 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.621033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585775-f3f8-4a73-92bb-dbb7c6fda083 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.621887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585775-f3f8-4a73-92bb-dbb7c6fda083 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.623739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc585775-f3f8-4a73-92bb-dbb7c6fda083 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:02.626025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc585775-f3f8-4a73-92bb-dbb7c6fda083 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:02.628983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 126/260] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:02 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:02.630031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585775-f3f8-4a73-92bb-dbb7c6fda083 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:02.717959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac523ef-c020-49a4-938e-db4883de8485 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:02.751956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44523e16-d812-4540-8947-35f1f31f0fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:02.752620 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44523e16-d812-4540-8947-35f1f31f0fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.752901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44523e16-d812-4540-8947-35f1f31f0fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.753177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44523e16-d812-4540-8947-35f1f31f0fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.754053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44523e16-d812-4540-8947-35f1f31f0fb9 None admin] RBAC: Adding query filter params (role.id=d81e3775c6c34914af06f7580faa79bf, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080, user.id=cdbb66ef26cc48c2a4d2ef21f90fad79) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:02.754399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44523e16-d812-4540-8947-35f1f31f0fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:02.755867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44523e16-d812-4540-8947-35f1f31f0fb9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:02.761391 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 135/261] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:02 2022] GET /identity/v3/role_assignments?user.id=cdbb66ef26cc48c2a4d2ef21f90fad79&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=d81e3775c6c34914af06f7580faa79bf => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:02.762030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44523e16-d812-4540-8947-35f1f31f0fb9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:02.764431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585775-f3f8-4a73-92bb-dbb7c6fda083 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:02.814980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753af58-b73f-4743-a776-17678f8070e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:02.815725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753af58-b73f-4743-a776-17678f8070e7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.817899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753af58-b73f-4743-a776-17678f8070e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.817899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753af58-b73f-4743-a776-17678f8070e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.836874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753af58-b73f-4743-a776-17678f8070e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:02.857704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-f753af58-b73f-4743-a776-17678f8070e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:11:02.859888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 127/262] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:11:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:02.867439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753af58-b73f-4743-a776-17678f8070e7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:02.944543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44523e16-d812-4540-8947-35f1f31f0fb9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:02.988349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376d520-b69b-46da-bce1-58bf5c0acf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:02.989406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376d520-b69b-46da-bce1-58bf5c0acf93 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:02.990794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376d520-b69b-46da-bce1-58bf5c0acf93 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:02.993427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376d520-b69b-46da-bce1-58bf5c0acf93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:02.994541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376d520-b69b-46da-bce1-58bf5c0acf93 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080, user.id=fcb97f798332486993c5e7e0a5fe20c1) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:02.995065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376d520-b69b-46da-bce1-58bf5c0acf93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:02.996735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376d520-b69b-46da-bce1-58bf5c0acf93 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:03.009518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 136/263] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:02 2022] GET /identity/v3/role_assignments?user.id=fcb97f798332486993c5e7e0a5fe20c1&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:03.010386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376d520-b69b-46da-bce1-58bf5c0acf93 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:03.049548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753af58-b73f-4743-a776-17678f8070e7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:03.098179 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe545f6c-7650-4e7a-8b90-1c06c2703534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:03.099035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe545f6c-7650-4e7a-8b90-1c06c2703534 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:03.099311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe545f6c-7650-4e7a-8b90-1c06c2703534 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:03.099583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe545f6c-7650-4e7a-8b90-1c06c2703534 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/users/9ef0ab0c618041b19c5bd120aa39fe68/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:03.103737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe545f6c-7650-4e7a-8b90-1c06c2703534 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080, user_id=9ef0ab0c618041b19c5bd120aa39fe68, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:03.105193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe545f6c-7650-4e7a-8b90-1c06c2703534 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:03.136376 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 128/264] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:11:02 2022] PUT /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/users/9ef0ab0c618041b19c5bd120aa39fe68/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:03.189147 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376d520-b69b-46da-bce1-58bf5c0acf93 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:03.240911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809816a6-b203-4c23-ab4d-5cce0adb2322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:03.243075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809816a6-b203-4c23-ab4d-5cce0adb2322 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:03.243357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809816a6-b203-4c23-ab4d-5cce0adb2322 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:03.243631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809816a6-b203-4c23-ab4d-5cce0adb2322 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:03.244391 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809816a6-b203-4c23-ab4d-5cce0adb2322 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:03.244697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809816a6-b203-4c23-ab4d-5cce0adb2322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:03.246133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809816a6-b203-4c23-ab4d-5cce0adb2322 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:03.258132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 137/265] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:03.264334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe545f6c-7650-4e7a-8b90-1c06c2703534 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:03.409288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe545f6c-7650-4e7a-8b90-1c06c2703534 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:03.455212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447f9f5-1213-4f78-86db-8fee25eb906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:03.456107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447f9f5-1213-4f78-86db-8fee25eb906e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:03.456386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447f9f5-1213-4f78-86db-8fee25eb906e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:03.456660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447f9f5-1213-4f78-86db-8fee25eb906e None admin] PATH_INFO: `/v3/users/fcb97f798332486993c5e7e0a5fe20c1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:03.463097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447f9f5-1213-4f78-86db-8fee25eb906e None admin] RBAC: Authorizing `identity:get_user(user_id=fcb97f798332486993c5e7e0a5fe20c1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:03.464588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447f9f5-1213-4f78-86db-8fee25eb906e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:03.466322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 129/266] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:03 2022] GET /identity/v3/users/fcb97f798332486993c5e7e0a5fe20c1 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:03.472263 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809816a6-b203-4c23-ab4d-5cce0adb2322 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:03.595745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809816a6-b203-4c23-ab4d-5cce0adb2322 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:03.634355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61865b-2eec-4dd3-b358-fbee8817fa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:03.635096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61865b-2eec-4dd3-b358-fbee8817fa80 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:03.635337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61865b-2eec-4dd3-b358-fbee8817fa80 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:03.638129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61865b-2eec-4dd3-b358-fbee8817fa80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:03.714091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61865b-2eec-4dd3-b358-fbee8817fa80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:03.715516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61865b-2eec-4dd3-b358-fbee8817fa80 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:03.817525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 138/267] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:03.823412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447f9f5-1213-4f78-86db-8fee25eb906e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:03.981936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447f9f5-1213-4f78-86db-8fee25eb906e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:03.986428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536d62c-0872-4dc1-93d4-705a617072a9 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:03.986724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536d62c-0872-4dc1-93d4-705a617072a9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:03.987008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536d62c-0872-4dc1-93d4-705a617072a9 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:03.989066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 139/268] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:03.994707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456379a-8568-49d4-871f-643e89b6f510 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:03.994999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456379a-8568-49d4-871f-643e89b6f510 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:03.995279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456379a-8568-49d4-871f-643e89b6f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.018358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8456379a-8568-49d4-871f-643e89b6f510 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:04.019877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8456379a-8568-49d4-871f-643e89b6f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:04.043366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93e9a9-f783-498c-85fa-d9b3f25b02cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:04.044241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93e9a9-f783-498c-85fa-d9b3f25b02cb None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:04.044528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93e9a9-f783-498c-85fa-d9b3f25b02cb None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:04.044786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93e9a9-f783-498c-85fa-d9b3f25b02cb None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.050887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93e9a9-f783-498c-85fa-d9b3f25b02cb None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:04.052350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93e9a9-f783-498c-85fa-d9b3f25b02cb None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:04.054930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 130/269] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:03 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:04.060532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93e9a9-f783-498c-85fa-d9b3f25b02cb None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:04.124450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 140/270] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:04.167370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93e9a9-f783-498c-85fa-d9b3f25b02cb None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:04.173850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456379a-8568-49d4-871f-643e89b6f510 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:04.206234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc117c9-5eb0-42b6-b6b7-ece61bf3d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:04.207256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc117c9-5eb0-42b6-b6b7-ece61bf3d987 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:04.207745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc117c9-5eb0-42b6-b6b7-ece61bf3d987 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:04.208242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc117c9-5eb0-42b6-b6b7-ece61bf3d987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.209270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc117c9-5eb0-42b6-b6b7-ece61bf3d987 None admin] RBAC: Adding query filter params (role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080, user.id=fcb97f798332486993c5e7e0a5fe20c1) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:04.209799 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc117c9-5eb0-42b6-b6b7-ece61bf3d987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:04.211526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc117c9-5eb0-42b6-b6b7-ece61bf3d987 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:04.217710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 131/271] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:04 2022] GET /identity/v3/role_assignments?user.id=fcb97f798332486993c5e7e0a5fe20c1&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:04.294033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560dd3-9759-4ae4-b5fb-133e0d0f973a None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:04.294683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560dd3-9759-4ae4-b5fb-133e0d0f973a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:04.295168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560dd3-9759-4ae4-b5fb-133e0d0f973a None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.297803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 132/272] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:04.303976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1111d-59f7-4e08-b55b-7f438a5fc774 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:04.305120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1111d-59f7-4e08-b55b-7f438a5fc774 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:04.305600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1111d-59f7-4e08-b55b-7f438a5fc774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.324915 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9ae1111d-59f7-4e08-b55b-7f438a5fc774 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:04.326564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9ae1111d-59f7-4e08-b55b-7f438a5fc774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:04.403684 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456379a-8568-49d4-871f-643e89b6f510 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:04.446931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 133/273] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:04.463636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cec48-1fd1-4e84-80bb-3148df249b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:04.464440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cec48-1fd1-4e84-80bb-3148df249b9b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:04.464783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cec48-1fd1-4e84-80bb-3148df249b9b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:04.465105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cec48-1fd1-4e84-80bb-3148df249b9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.472553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1111d-59f7-4e08-b55b-7f438a5fc774 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:04.480672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cec48-1fd1-4e84-80bb-3148df249b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:04.488168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-120cec48-1fd1-4e84-80bb-3148df249b9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:04.489812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 141/274] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:04.496268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cec48-1fd1-4e84-80bb-3148df249b9b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:04.590164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1111d-59f7-4e08-b55b-7f438a5fc774 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:04.597163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cec48-1fd1-4e84-80bb-3148df249b9b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:04.629748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed46bd-c9dc-465e-b902-3fae4e1d08a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:04.631098 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed46bd-c9dc-465e-b902-3fae4e1d08a3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:04.631598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed46bd-c9dc-465e-b902-3fae4e1d08a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:04.632054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed46bd-c9dc-465e-b902-3fae4e1d08a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.632185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174cbe5-c1ab-49b2-b262-004e262d792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:04.632922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174cbe5-c1ab-49b2-b262-004e262d792e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:04.633239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174cbe5-c1ab-49b2-b262-004e262d792e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:04.633631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174cbe5-c1ab-49b2-b262-004e262d792e None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.634122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed46bd-c9dc-465e-b902-3fae4e1d08a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:04.634553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174cbe5-c1ab-49b2-b262-004e262d792e None admin] RBAC: Adding query filter params (name=member) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:04.634973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174cbe5-c1ab-49b2-b262-004e262d792e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:04.636380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174cbe5-c1ab-49b2-b262-004e262d792e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:04.636503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed46bd-c9dc-465e-b902-3fae4e1d08a3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:04.638613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 134/275] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:04.644186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed46bd-c9dc-465e-b902-3fae4e1d08a3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:04.645394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 142/276] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:04.651942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174cbe5-c1ab-49b2-b262-004e262d792e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:04.774867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed46bd-c9dc-465e-b902-3fae4e1d08a3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:04.784556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174cbe5-c1ab-49b2-b262-004e262d792e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:04.810472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbb77a-101e-4cd0-8e1e-c35b6291e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:04.811152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbb77a-101e-4cd0-8e1e-c35b6291e9ad None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:04.811435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbb77a-101e-4cd0-8e1e-c35b6291e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:04.811714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbb77a-101e-4cd0-8e1e-c35b6291e9ad None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.812789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbb77a-101e-4cd0-8e1e-c35b6291e9ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:04.813859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbb77a-101e-4cd0-8e1e-c35b6291e9ad None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:04.829142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad5338-0be4-4de3-8908-8d920fc93a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:04.830947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad5338-0be4-4de3-8908-8d920fc93a71 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:04.831457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad5338-0be4-4de3-8908-8d920fc93a71 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:04.832005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad5338-0be4-4de3-8908-8d920fc93a71 None admin] PATH_INFO: `/v3/users/4c35074d21ce4c629badaf1c6b54400e` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:04.838133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 135/277] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:11:04 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:11:04.858139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad5338-0be4-4de3-8908-8d920fc93a71 None admin] RBAC: Authorizing `identity:get_user(user_id=4c35074d21ce4c629badaf1c6b54400e)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:04.859904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad5338-0be4-4de3-8908-8d920fc93a71 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:04.862228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 143/278] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:04 2022] GET /identity/v3/users/4c35074d21ce4c629badaf1c6b54400e => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:04.868363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbb77a-101e-4cd0-8e1e-c35b6291e9ad None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:04.980644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbb77a-101e-4cd0-8e1e-c35b6291e9ad None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:05.017552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829648f-6641-4def-b7aa-e579229f1b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:05.018602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829648f-6641-4def-b7aa-e579229f1b47 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:05.019033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829648f-6641-4def-b7aa-e579229f1b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:05.019438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829648f-6641-4def-b7aa-e579229f1b47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:05.020408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829648f-6641-4def-b7aa-e579229f1b47 None admin] RBAC: Adding query filter params (role.id=43e227d04ba64588acce441d98a394f3, user.id=4c35074d21ce4c629badaf1c6b54400e, scope.system=all) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:05.020866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829648f-6641-4def-b7aa-e579229f1b47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:05.022509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829648f-6641-4def-b7aa-e579229f1b47 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:05.028890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 136/279] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Mar 10 17:11:04 2022] GET /identity/v3/role_assignments?user.id=4c35074d21ce4c629badaf1c6b54400e&scope.system=all&role.id=43e227d04ba64588acce441d98a394f3 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:05.656897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3a16d-9899-4eda-aa48-8afdd1b796f9 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:05.657376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3a16d-9899-4eda-aa48-8afdd1b796f9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:05.657376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3a16d-9899-4eda-aa48-8afdd1b796f9 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:05.659464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 144/280] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:05.676063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785e451-3a7d-4fd3-a82c-8c601e1f0243 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:05.676360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785e451-3a7d-4fd3-a82c-8c601e1f0243 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:05.676644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785e451-3a7d-4fd3-a82c-8c601e1f0243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:05.699022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1785e451-3a7d-4fd3-a82c-8c601e1f0243 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:05.700213 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1785e451-3a7d-4fd3-a82c-8c601e1f0243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:05.783592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 137/281] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:05.823663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3a16d-9899-4eda-aa48-8afdd1b796f9 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:05.967875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3a16d-9899-4eda-aa48-8afdd1b796f9 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:06.031696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45bcfd-22ed-4017-990f-2f79976e7b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:06.032507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45bcfd-22ed-4017-990f-2f79976e7b43 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:06.032794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45bcfd-22ed-4017-990f-2f79976e7b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:06.033072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45bcfd-22ed-4017-990f-2f79976e7b43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:06.055345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45bcfd-22ed-4017-990f-2f79976e7b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:06.063056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-be45bcfd-22ed-4017-990f-2f79976e7b43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 17:11:06.064533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 145/282] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:06.071042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785e451-3a7d-4fd3-a82c-8c601e1f0243 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:06.252969 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785e451-3a7d-4fd3-a82c-8c601e1f0243 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:06.316438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c669201-9a4e-468b-8e9d-8e60333f58fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:06.317133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669201-9a4e-468b-8e9d-8e60333f58fe None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:06.317419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669201-9a4e-468b-8e9d-8e60333f58fe None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:06.317694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669201-9a4e-468b-8e9d-8e60333f58fe None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:06.319823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c669201-9a4e-468b-8e9d-8e60333f58fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:06.320143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c669201-9a4e-468b-8e9d-8e60333f58fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:06.321542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c669201-9a4e-468b-8e9d-8e60333f58fe None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:06.333338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 138/283] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:06.340021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45bcfd-22ed-4017-990f-2f79976e7b43 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:06.485222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e4999-a065-4aa9-90de-b5fa57991531 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:06.485513 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e4999-a065-4aa9-90de-b5fa57991531 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:06.485792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e4999-a065-4aa9-90de-b5fa57991531 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:06.487900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 139/284] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:06.494025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7592-2ea3-4593-9dea-fbfb63847011 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:06.494363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7592-2ea3-4593-9dea-fbfb63847011 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:06.494705 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7592-2ea3-4593-9dea-fbfb63847011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:06.534332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-432a7592-2ea3-4593-9dea-fbfb63847011 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:06.535461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-432a7592-2ea3-4593-9dea-fbfb63847011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:06.544418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45bcfd-22ed-4017-990f-2f79976e7b43 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:06.584819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5b08a-a374-4cc5-952d-c27f00d1374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:06.588083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5b08a-a374-4cc5-952d-c27f00d1374a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:06.588637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5b08a-a374-4cc5-952d-c27f00d1374a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:06.589296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5b08a-a374-4cc5-952d-c27f00d1374a None admin] PATH_INFO: `/v3/users/cdbb66ef26cc48c2a4d2ef21f90fad79` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:06.591915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5b08a-a374-4cc5-952d-c27f00d1374a None admin] RBAC: Authorizing `identity:get_user(user_id=cdbb66ef26cc48c2a4d2ef21f90fad79)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:06.593806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5b08a-a374-4cc5-952d-c27f00d1374a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:06.598218 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 146/285] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:06 2022] GET /identity/v3/users/cdbb66ef26cc48c2a4d2ef21f90fad79 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:06.604191 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5b08a-a374-4cc5-952d-c27f00d1374a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:06.699574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 140/286] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:06.765447 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7592-2ea3-4593-9dea-fbfb63847011 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:06.800562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5b08a-a374-4cc5-952d-c27f00d1374a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:06.864728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1c1c8-1700-443b-af2f-99da4c46a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:06.865938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c1c8-1700-443b-af2f-99da4c46a389 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:06.866960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c1c8-1700-443b-af2f-99da4c46a389 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:06.867399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c1c8-1700-443b-af2f-99da4c46a389 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:06.868804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1c1c8-1700-443b-af2f-99da4c46a389 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:06.874388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1c1c8-1700-443b-af2f-99da4c46a389 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:06.876680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 147/287] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:06 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:06.882015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1c1c8-1700-443b-af2f-99da4c46a389 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:06.912813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7592-2ea3-4593-9dea-fbfb63847011 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:06.954230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176aacc-327a-4ef6-81c2-c5bdabf141ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:06.955322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176aacc-327a-4ef6-81c2-c5bdabf141ce None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:06.955812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176aacc-327a-4ef6-81c2-c5bdabf141ce None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:06.956265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176aacc-327a-4ef6-81c2-c5bdabf141ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:06.974640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176aacc-327a-4ef6-81c2-c5bdabf141ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:06.982735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-b176aacc-327a-4ef6-81c2-c5bdabf141ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:06.995818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 141/288] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:07.000032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176aacc-327a-4ef6-81c2-c5bdabf141ce None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:07.064013 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1c1c8-1700-443b-af2f-99da4c46a389 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:07.134302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d37b98-ffee-4df3-8bdb-217717b3c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:07.135501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d37b98-ffee-4df3-8bdb-217717b3c04a None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:07.135963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d37b98-ffee-4df3-8bdb-217717b3c04a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:07.136445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d37b98-ffee-4df3-8bdb-217717b3c04a None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/users/cdbb66ef26cc48c2a4d2ef21f90fad79/roles/d81e3775c6c34914af06f7580faa79bf` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:07.141880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d37b98-ffee-4df3-8bdb-217717b3c04a None admin] RBAC: Authorizing `identity:create_grant(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080, user_id=cdbb66ef26cc48c2a4d2ef21f90fad79, role_id=d81e3775c6c34914af06f7580faa79bf)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:07.143567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d37b98-ffee-4df3-8bdb-217717b3c04a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:07.164074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 148/289] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:11:06 2022] PUT /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/users/cdbb66ef26cc48c2a4d2ef21f90fad79/roles/d81e3775c6c34914af06f7580faa79bf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:07.175783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176aacc-327a-4ef6-81c2-c5bdabf141ce None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:07.214223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959870f1-6c6a-4c3d-98a6-bf2e3da576af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:07.215293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959870f1-6c6a-4c3d-98a6-bf2e3da576af None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:07.215784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959870f1-6c6a-4c3d-98a6-bf2e3da576af None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:07.216245 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959870f1-6c6a-4c3d-98a6-bf2e3da576af None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:07.217262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959870f1-6c6a-4c3d-98a6-bf2e3da576af None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:07.217779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959870f1-6c6a-4c3d-98a6-bf2e3da576af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:07.219433 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959870f1-6c6a-4c3d-98a6-bf2e3da576af None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:07.234552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 142/290] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:07.236408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d37b98-ffee-4df3-8bdb-217717b3c04a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:07.371427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d37b98-ffee-4df3-8bdb-217717b3c04a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:07.406235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245666bb-35f9-42e0-afd5-704383008096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:07.407127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245666bb-35f9-42e0-afd5-704383008096 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:07.407415 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245666bb-35f9-42e0-afd5-704383008096 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:07.407696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245666bb-35f9-42e0-afd5-704383008096 None admin] PATH_INFO: `/v3/users/9ef0ab0c618041b19c5bd120aa39fe68` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:07.408915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245666bb-35f9-42e0-afd5-704383008096 None admin] RBAC: Authorizing `identity:get_user(user_id=9ef0ab0c618041b19c5bd120aa39fe68)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:07.410399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245666bb-35f9-42e0-afd5-704383008096 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:07.412303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 149/291] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:07 2022] GET /identity/v3/users/9ef0ab0c618041b19c5bd120aa39fe68 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:07.418261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959870f1-6c6a-4c3d-98a6-bf2e3da576af None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:07.522920 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959870f1-6c6a-4c3d-98a6-bf2e3da576af None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:07.559111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b0843-d30b-4ffe-9df8-3244582ba0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:07.559762 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b0843-d30b-4ffe-9df8-3244582ba0ce None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:07.560050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b0843-d30b-4ffe-9df8-3244582ba0ce None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:07.560330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b0843-d30b-4ffe-9df8-3244582ba0ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:07.631187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b0843-d30b-4ffe-9df8-3244582ba0ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:07.632623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b0843-d30b-4ffe-9df8-3244582ba0ce None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:07.732559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 143/292] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:07.738035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245666bb-35f9-42e0-afd5-704383008096 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:07.805801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77153-92cf-49a2-b0e2-419e8fdf6959 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:07.806165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77153-92cf-49a2-b0e2-419e8fdf6959 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:07.806396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77153-92cf-49a2-b0e2-419e8fdf6959 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:07.808182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 144/293] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:07.813775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b4108-8d72-4ac9-a058-b23d7bf98ca7 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:07.814066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b4108-8d72-4ac9-a058-b23d7bf98ca7 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:07.814374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b4108-8d72-4ac9-a058-b23d7bf98ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:07.843090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d27b4108-8d72-4ac9-a058-b23d7bf98ca7 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:07.844291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d27b4108-8d72-4ac9-a058-b23d7bf98ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:07.875762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245666bb-35f9-42e0-afd5-704383008096 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:07.918182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 145/294] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:07.931714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d6929-38df-48ef-abf1-e4964afef2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:07.932803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d6929-38df-48ef-abf1-e4964afef2ee None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:07.933254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d6929-38df-48ef-abf1-e4964afef2ee None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:07.935545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d6929-38df-48ef-abf1-e4964afef2ee None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:07.936940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d6929-38df-48ef-abf1-e4964afef2ee None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:07.938601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d6929-38df-48ef-abf1-e4964afef2ee None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:07.941226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 150/295] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:07 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:07.947802 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b4108-8d72-4ac9-a058-b23d7bf98ca7 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:07.953619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d6929-38df-48ef-abf1-e4964afef2ee None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:08.072044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b4108-8d72-4ac9-a058-b23d7bf98ca7 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.072605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d6929-38df-48ef-abf1-e4964afef2ee None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.103577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca585f-fd86-416c-a91a-f2ed5cb352b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.103916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac82d3-75d3-407e-a469-1c9c029392da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.104369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca585f-fd86-416c-a91a-f2ed5cb352b4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.104573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac82d3-75d3-407e-a469-1c9c029392da None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.104691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca585f-fd86-416c-a91a-f2ed5cb352b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.104858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac82d3-75d3-407e-a469-1c9c029392da None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.104953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca585f-fd86-416c-a91a-f2ed5cb352b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.105136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac82d3-75d3-407e-a469-1c9c029392da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.105959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac82d3-75d3-407e-a469-1c9c029392da None admin] RBAC: Adding query filter params (role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080, user.id=9ef0ab0c618041b19c5bd120aa39fe68) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:08.106306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac82d3-75d3-407e-a469-1c9c029392da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:08.107750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac82d3-75d3-407e-a469-1c9c029392da None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:08.118141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 151/296] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:07 2022] GET /identity/v3/role_assignments?user.id=9ef0ab0c618041b19c5bd120aa39fe68&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=43e227d04ba64588acce441d98a394f3 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:08.118141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8dc1-af1c-4873-b217-7273b25eade8 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.118141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8dc1-af1c-4873-b217-7273b25eade8 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.118141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8dc1-af1c-4873-b217-7273b25eade8 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.118141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 152/297] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:08.119041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38924f-9ca4-4c39-803a-e4d2ca37f420 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.126705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38924f-9ca4-4c39-803a-e4d2ca37f420 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.126705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38924f-9ca4-4c39-803a-e4d2ca37f420 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.126705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 153/298] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:08.127023 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca585f-fd86-416c-a91a-f2ed5cb352b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:08.128074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24198311-6178-4f7a-b07f-b44e4d54d379 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.128367 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24198311-6178-4f7a-b07f-b44e4d54d379 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.128645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24198311-6178-4f7a-b07f-b44e4d54d379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.133818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-8eca585f-fd86-416c-a91a-f2ed5cb352b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:08.135118 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 146/299] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:08.136333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e7ed2-b506-4fe5-9823-711b29d03867 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.136617 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e7ed2-b506-4fe5-9823-711b29d03867 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.136890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e7ed2-b506-4fe5-9823-711b29d03867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.150762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-24198311-6178-4f7a-b07f-b44e4d54d379 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:08.151972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-24198311-6178-4f7a-b07f-b44e4d54d379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:08.158414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-da0e7ed2-b506-4fe5-9823-711b29d03867 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:08.159631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-da0e7ed2-b506-4fe5-9823-711b29d03867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:08.229890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 147/300] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:08.231679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e7ed2-b506-4fe5-9823-711b29d03867 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:08.250869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 154/301] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:08.275318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24198311-6178-4f7a-b07f-b44e4d54d379 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:08.364854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e7ed2-b506-4fe5-9823-711b29d03867 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.401393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24198311-6178-4f7a-b07f-b44e4d54d379 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.405747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0942b-c1bd-4693-b421-6de462f8c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.406574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0942b-c1bd-4693-b421-6de462f8c1ac None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.406941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0942b-c1bd-4693-b421-6de462f8c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.407423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0942b-c1bd-4693-b421-6de462f8c1ac None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.408259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0942b-c1bd-4693-b421-6de462f8c1ac None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:08.408635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0942b-c1bd-4693-b421-6de462f8c1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:08.410140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0942b-c1bd-4693-b421-6de462f8c1ac None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:08.419150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 148/302] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:08.420338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0942b-c1bd-4693-b421-6de462f8c1ac None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:08.437328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47688b8-c73f-4073-a22e-ec3a8dde9b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.438148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47688b8-c73f-4073-a22e-ec3a8dde9b2e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.438503 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47688b8-c73f-4073-a22e-ec3a8dde9b2e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.438720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47688b8-c73f-4073-a22e-ec3a8dde9b2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.439881 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47688b8-c73f-4073-a22e-ec3a8dde9b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:08.441315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47688b8-c73f-4073-a22e-ec3a8dde9b2e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:08.447492 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 155/303] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:08.447492 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47688b8-c73f-4073-a22e-ec3a8dde9b2e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:08.526511 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0942b-c1bd-4693-b421-6de462f8c1ac None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.550148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47688b8-c73f-4073-a22e-ec3a8dde9b2e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.561829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33f08b-0ae3-4c37-9277-432442b0e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.562662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33f08b-0ae3-4c37-9277-432442b0e928 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.562954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33f08b-0ae3-4c37-9277-432442b0e928 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.563223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33f08b-0ae3-4c37-9277-432442b0e928 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.573108 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33f08b-0ae3-4c37-9277-432442b0e928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:08.580203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-7f33f08b-0ae3-4c37-9277-432442b0e928 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 17:11:08.581686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 149/304] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:08.582483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33f08b-0ae3-4c37-9277-432442b0e928 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:08.585864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942f8ac-92ad-46da-b349-1ebc2db7f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.586831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942f8ac-92ad-46da-b349-1ebc2db7f190 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.587229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942f8ac-92ad-46da-b349-1ebc2db7f190 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.587510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942f8ac-92ad-46da-b349-1ebc2db7f190 None admin] PATH_INFO: `/v3/users/4c35074d21ce4c629badaf1c6b54400e` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.588699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942f8ac-92ad-46da-b349-1ebc2db7f190 None admin] RBAC: Authorizing `identity:get_user(user_id=4c35074d21ce4c629badaf1c6b54400e)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:08.591215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942f8ac-92ad-46da-b349-1ebc2db7f190 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:08.592987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 156/305] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:08 2022] GET /identity/v3/users/4c35074d21ce4c629badaf1c6b54400e => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:08.593570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942f8ac-92ad-46da-b349-1ebc2db7f190 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:08.686427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33f08b-0ae3-4c37-9277-432442b0e928 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.697376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942f8ac-92ad-46da-b349-1ebc2db7f190 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.718937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33fb01-d168-43d0-b61b-f5cb8af73969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.719593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33fb01-d168-43d0-b61b-f5cb8af73969 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.719880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33fb01-d168-43d0-b61b-f5cb8af73969 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.720163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33fb01-d168-43d0-b61b-f5cb8af73969 None admin] PATH_INFO: `/v3/groups` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.720842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33fb01-d168-43d0-b61b-f5cb8af73969 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:08.722315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33fb01-d168-43d0-b61b-f5cb8af73969 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:08.732440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575c3a-7e1c-421f-98c1-128cea377862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.733438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575c3a-7e1c-421f-98c1-128cea377862 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.733842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575c3a-7e1c-421f-98c1-128cea377862 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.734446 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575c3a-7e1c-421f-98c1-128cea377862 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.735492 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86575c3a-7e1c-421f-98c1-128cea377862 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:08.735803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86575c3a-7e1c-421f-98c1-128cea377862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:08.737160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86575c3a-7e1c-421f-98c1-128cea377862 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:08.739382 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 150/306] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Mar 10 17:11:08 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:11:08.740085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33fb01-d168-43d0-b61b-f5cb8af73969 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:08.762296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 157/307] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:08.763742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575c3a-7e1c-421f-98c1-128cea377862 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:08.853987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33fb01-d168-43d0-b61b-f5cb8af73969 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.871114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575c3a-7e1c-421f-98c1-128cea377862 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:08.890402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f830e-8d1b-448f-b920-c6f26a5f2c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.891761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f830e-8d1b-448f-b920-c6f26a5f2c5a None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.892269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f830e-8d1b-448f-b920-c6f26a5f2c5a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.892800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f830e-8d1b-448f-b920-c6f26a5f2c5a None admin] PATH_INFO: `/v3/system/users/4c35074d21ce4c629badaf1c6b54400e/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.894743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f830e-8d1b-448f-b920-c6f26a5f2c5a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4c35074d21ce4c629badaf1c6b54400e, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:08.896427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f830e-8d1b-448f-b920-c6f26a5f2c5a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:08.907411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc717d53-90c9-42ca-9d85-5a92f658adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:08.908355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc717d53-90c9-42ca-9d85-5a92f658adb7 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:08.908637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc717d53-90c9-42ca-9d85-5a92f658adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:08.908903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 151/308] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Mar 10 17:11:08 2022] PUT /identity/v3/system/users/4c35074d21ce4c629badaf1c6b54400e/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:08.914385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc717d53-90c9-42ca-9d85-5a92f658adb7 None admin] PATH_INFO: `/v3/users/db3c95016e2a4646ba9319c6db41fbfa` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:08.930333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc717d53-90c9-42ca-9d85-5a92f658adb7 None admin] RBAC: Authorizing `identity:get_user(user_id=db3c95016e2a4646ba9319c6db41fbfa)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:08.931838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc717d53-90c9-42ca-9d85-5a92f658adb7 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:08.938214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 158/309] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:08 2022] GET /identity/v3/users/db3c95016e2a4646ba9319c6db41fbfa => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:08.939891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f830e-8d1b-448f-b920-c6f26a5f2c5a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:09.051787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f830e-8d1b-448f-b920-c6f26a5f2c5a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:09.087650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab010941-c80b-422a-b47f-d7de372e37fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:09.088367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010941-c80b-422a-b47f-d7de372e37fb None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:09.088656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010941-c80b-422a-b47f-d7de372e37fb None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:09.088931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010941-c80b-422a-b47f-d7de372e37fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:09.089773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab010941-c80b-422a-b47f-d7de372e37fb None admin] RBAC: Adding query filter params (role.id=d81e3775c6c34914af06f7580faa79bf, user.id=db3c95016e2a4646ba9319c6db41fbfa, scope.system=all) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:09.090082 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab010941-c80b-422a-b47f-d7de372e37fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:09.091552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab010941-c80b-422a-b47f-d7de372e37fb None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:09.097249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 152/310] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Mar 10 17:11:08 2022] GET /identity/v3/role_assignments?user.id=db3c95016e2a4646ba9319c6db41fbfa&scope.system=all&role.id=d81e3775c6c34914af06f7580faa79bf => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:09.828630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418c7b8-63c2-432c-b702-cdbb2b4c6a55 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:09.829002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418c7b8-63c2-432c-b702-cdbb2b4c6a55 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:09.829196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418c7b8-63c2-432c-b702-cdbb2b4c6a55 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:09.831282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 159/311] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:09.837157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1291-145a-4ead-a553-e0ad83831342 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:09.837593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1291-145a-4ead-a553-e0ad83831342 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:09.837765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1291-145a-4ead-a553-e0ad83831342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:09.854680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-865f1291-145a-4ead-a553-e0ad83831342 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:09.855852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-865f1291-145a-4ead-a553-e0ad83831342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:09.930290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 153/312] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:09.951315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418c7b8-63c2-432c-b702-cdbb2b4c6a55 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:10.057582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418c7b8-63c2-432c-b702-cdbb2b4c6a55 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:10.091534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5375bb6-c822-42eb-93a2-d6fb36aae251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:10.092260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5375bb6-c822-42eb-93a2-d6fb36aae251 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:10.092545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5375bb6-c822-42eb-93a2-d6fb36aae251 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:10.092817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5375bb6-c822-42eb-93a2-d6fb36aae251 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:10.102824 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5375bb6-c822-42eb-93a2-d6fb36aae251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:10.109774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-e5375bb6-c822-42eb-93a2-d6fb36aae251 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 17:11:10.115410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 160/313] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:10.117732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1291-145a-4ead-a553-e0ad83831342 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:10.214795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1291-145a-4ead-a553-e0ad83831342 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:10.250167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c76ad9-fa10-4ee6-8def-cc23957ae78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:10.250846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c76ad9-fa10-4ee6-8def-cc23957ae78d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:10.251129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c76ad9-fa10-4ee6-8def-cc23957ae78d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:10.251408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c76ad9-fa10-4ee6-8def-cc23957ae78d None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:10.252171 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c76ad9-fa10-4ee6-8def-cc23957ae78d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:10.252475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c76ad9-fa10-4ee6-8def-cc23957ae78d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:10.253866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c76ad9-fa10-4ee6-8def-cc23957ae78d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:10.266222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 154/314] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:10.277524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5375bb6-c822-42eb-93a2-d6fb36aae251 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:10.389027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5375bb6-c822-42eb-93a2-d6fb36aae251 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:10.422267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bf700-98ef-4328-9bd4-b4e27910cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:10.423145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bf700-98ef-4328-9bd4-b4e27910cc59 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:10.423427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bf700-98ef-4328-9bd4-b4e27910cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:10.423702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bf700-98ef-4328-9bd4-b4e27910cc59 None admin] PATH_INFO: `/v3/users/cdbb66ef26cc48c2a4d2ef21f90fad79` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:10.424897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bf700-98ef-4328-9bd4-b4e27910cc59 None admin] RBAC: Authorizing `identity:get_user(user_id=cdbb66ef26cc48c2a4d2ef21f90fad79)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:10.426369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bf700-98ef-4328-9bd4-b4e27910cc59 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:10.428260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 161/315] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:10 2022] GET /identity/v3/users/cdbb66ef26cc48c2a4d2ef21f90fad79 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:10.434241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c76ad9-fa10-4ee6-8def-cc23957ae78d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:10.530360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c76ad9-fa10-4ee6-8def-cc23957ae78d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:10.563639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b269-d2f3-4254-846b-811a9fe5921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:10.564285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b269-d2f3-4254-846b-811a9fe5921b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:10.564569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b269-d2f3-4254-846b-811a9fe5921b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:10.564844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b269-d2f3-4254-846b-811a9fe5921b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:10.634384 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b269-d2f3-4254-846b-811a9fe5921b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:10.635892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b269-d2f3-4254-846b-811a9fe5921b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:10.737319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 155/316] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:10.743079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bf700-98ef-4328-9bd4-b4e27910cc59 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:10.847267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bf700-98ef-4328-9bd4-b4e27910cc59 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:10.881967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1428d8-bffe-49bc-bc66-06fc6b4fa526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:10.882878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1428d8-bffe-49bc-bc66-06fc6b4fa526 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:10.883160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1428d8-bffe-49bc-bc66-06fc6b4fa526 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:10.883436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1428d8-bffe-49bc-bc66-06fc6b4fa526 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:10.884637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1428d8-bffe-49bc-bc66-06fc6b4fa526 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:10.886089 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1428d8-bffe-49bc-bc66-06fc6b4fa526 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:10.887792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 162/317] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:10 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:10.893774 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b269-d2f3-4254-846b-811a9fe5921b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:10.996252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b269-d2f3-4254-846b-811a9fe5921b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:11.029627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c9956-0e62-476f-919b-cc2dee17af30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:11.030313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c9956-0e62-476f-919b-cc2dee17af30 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.030596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c9956-0e62-476f-919b-cc2dee17af30 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.030862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c9956-0e62-476f-919b-cc2dee17af30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.031692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c9956-0e62-476f-919b-cc2dee17af30 None admin] RBAC: Adding query filter params (role.id=d81e3775c6c34914af06f7580faa79bf, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080, user.id=cdbb66ef26cc48c2a4d2ef21f90fad79) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:11.031999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c9956-0e62-476f-919b-cc2dee17af30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:11.033427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c9956-0e62-476f-919b-cc2dee17af30 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:11.046263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 156/318] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:10 2022] GET /identity/v3/role_assignments?user.id=cdbb66ef26cc48c2a4d2ef21f90fad79&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=d81e3775c6c34914af06f7580faa79bf => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:11.207328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e79932-bd76-4fe8-923c-2718f2a07e32 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.207989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e79932-bd76-4fe8-923c-2718f2a07e32 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.207989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e79932-bd76-4fe8-923c-2718f2a07e32 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.209667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 163/319] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:11.215936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb16126-1119-4244-8f41-112de6d7e089 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.216217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb16126-1119-4244-8f41-112de6d7e089 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.216505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb16126-1119-4244-8f41-112de6d7e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.234641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1eb16126-1119-4244-8f41-112de6d7e089 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:11.235835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1eb16126-1119-4244-8f41-112de6d7e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:11.291062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1966efc-ef18-4ae7-831e-51fc1061e9d9 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.291354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1966efc-ef18-4ae7-831e-51fc1061e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.291552 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1966efc-ef18-4ae7-831e-51fc1061e9d9 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.293571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 164/320] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:11.298711 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ccca7-30fc-407b-962e-fac05b95a8e9 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.299002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ccca7-30fc-407b-962e-fac05b95a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.299286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ccca7-30fc-407b-962e-fac05b95a8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.316111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 157/321] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:11.326039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ef2ccca7-30fc-407b-962e-fac05b95a8e9 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:11.328833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ef2ccca7-30fc-407b-962e-fac05b95a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:11.340500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb16126-1119-4244-8f41-112de6d7e089 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:11.402158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 165/322] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:11.421297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ccca7-30fc-407b-962e-fac05b95a8e9 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:11.439088 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb16126-1119-4244-8f41-112de6d7e089 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:11.473309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3177f8-82a3-444d-a472-635bcf4ac242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:11.474945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3177f8-82a3-444d-a472-635bcf4ac242 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.475763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3177f8-82a3-444d-a472-635bcf4ac242 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.476271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3177f8-82a3-444d-a472-635bcf4ac242 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.478417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3177f8-82a3-444d-a472-635bcf4ac242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:11.480662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3177f8-82a3-444d-a472-635bcf4ac242 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:11.482348 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 158/323] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:11.483527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d825db-6d9f-40e1-92f3-ff56bbc4850d None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.483816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d825db-6d9f-40e1-92f3-ff56bbc4850d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.484095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d825db-6d9f-40e1-92f3-ff56bbc4850d None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.485956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 159/324] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:11.487851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d825db-6d9f-40e1-92f3-ff56bbc4850d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:11.520576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ccca7-30fc-407b-962e-fac05b95a8e9 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:11.551999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a582d00-2d5d-46ec-b6f1-704e8192613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:11.552727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582d00-2d5d-46ec-b6f1-704e8192613b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.553007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582d00-2d5d-46ec-b6f1-704e8192613b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.553278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582d00-2d5d-46ec-b6f1-704e8192613b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.563295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a582d00-2d5d-46ec-b6f1-704e8192613b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:11.570772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-6a582d00-2d5d-46ec-b6f1-704e8192613b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:11.572086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 166/325] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:11.573051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6efed-25e8-40d3-8719-3b6e4f3c643d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.573331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6efed-25e8-40d3-8719-3b6e4f3c643d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.573603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6efed-25e8-40d3-8719-3b6e4f3c643d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.585067 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d825db-6d9f-40e1-92f3-ff56bbc4850d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:11.589124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c3b6efed-25e8-40d3-8719-3b6e4f3c643d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:11.590324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c3b6efed-25e8-40d3-8719-3b6e4f3c643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:11.617130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec18ec-2fbb-4575-ae63-bd5003d397cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:11.617680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec18ec-2fbb-4575-ae63-bd5003d397cd None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.617962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec18ec-2fbb-4575-ae63-bd5003d397cd None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.618271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec18ec-2fbb-4575-ae63-bd5003d397cd None admin] PATH_INFO: `/v3/groups` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.618979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec18ec-2fbb-4575-ae63-bd5003d397cd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:11.620403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec18ec-2fbb-4575-ae63-bd5003d397cd None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:11.634800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 160/326] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Mar 10 17:11:11 2022] POST /identity/v3/groups => generated 226 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:11:11.635623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec18ec-2fbb-4575-ae63-bd5003d397cd None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:11.669127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 167/327] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:11.692753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6efed-25e8-40d3-8719-3b6e4f3c643d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:11.740775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec18ec-2fbb-4575-ae63-bd5003d397cd None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:11.775542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4f18b-31a4-41f4-9a07-c0754a98e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:11.776216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f18b-31a4-41f4-9a07-c0754a98e1ba None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.776486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f18b-31a4-41f4-9a07-c0754a98e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.776763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f18b-31a4-41f4-9a07-c0754a98e1ba None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.777514 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4f18b-31a4-41f4-9a07-c0754a98e1ba None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:11.777815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4f18b-31a4-41f4-9a07-c0754a98e1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:11.779229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4f18b-31a4-41f4-9a07-c0754a98e1ba None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:11.789068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 161/328] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:11.795136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6efed-25e8-40d3-8719-3b6e4f3c643d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:11.795343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4f18b-31a4-41f4-9a07-c0754a98e1ba None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:11.830394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddc5b8-2e07-48e0-bbae-bbba324cd96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:11.831129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddc5b8-2e07-48e0-bbae-bbba324cd96d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.831409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddc5b8-2e07-48e0-bbae-bbba324cd96d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.831677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddc5b8-2e07-48e0-bbae-bbba324cd96d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.843885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddc5b8-2e07-48e0-bbae-bbba324cd96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:11.851561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-c0ddc5b8-2e07-48e0-bbae-bbba324cd96d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 17:11:11.852926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 168/329] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:11.858376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddc5b8-2e07-48e0-bbae-bbba324cd96d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:11.905340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4f18b-31a4-41f4-9a07-c0754a98e1ba None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:11.945827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db36930-d52b-4a56-8f18-eba5501a9a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:11.946742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db36930-d52b-4a56-8f18-eba5501a9a92 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:11.947031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db36930-d52b-4a56-8f18-eba5501a9a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:11.947306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db36930-d52b-4a56-8f18-eba5501a9a92 None admin] PATH_INFO: `/v3/users/4c35074d21ce4c629badaf1c6b54400e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:11.949264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db36930-d52b-4a56-8f18-eba5501a9a92 None admin] RBAC: Authorizing `identity:get_user(user_id=4c35074d21ce4c629badaf1c6b54400e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:11.950751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db36930-d52b-4a56-8f18-eba5501a9a92 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:11.952778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 162/330] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:11 2022] GET /identity/v3/users/4c35074d21ce4c629badaf1c6b54400e => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:11.960080 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db36930-d52b-4a56-8f18-eba5501a9a92 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:11.961551 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddc5b8-2e07-48e0-bbae-bbba324cd96d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:11.999509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940823e5-4466-4061-bb75-3e68fe6c8963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:12.000200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940823e5-4466-4061-bb75-3e68fe6c8963 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:12.000484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940823e5-4466-4061-bb75-3e68fe6c8963 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:12.000819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940823e5-4466-4061-bb75-3e68fe6c8963 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:12.001579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940823e5-4466-4061-bb75-3e68fe6c8963 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:12.001930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940823e5-4466-4061-bb75-3e68fe6c8963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:12.003850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940823e5-4466-4061-bb75-3e68fe6c8963 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:12.014406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 169/331] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:12.018658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940823e5-4466-4061-bb75-3e68fe6c8963 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:12.076446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db36930-d52b-4a56-8f18-eba5501a9a92 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:12.111194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b0ebe-02e2-4922-95e3-9f9c91c8ac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:12.111777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b0ebe-02e2-4922-95e3-9f9c91c8ac75 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:12.112059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b0ebe-02e2-4922-95e3-9f9c91c8ac75 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:12.112345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b0ebe-02e2-4922-95e3-9f9c91c8ac75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:12.113176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b0ebe-02e2-4922-95e3-9f9c91c8ac75 None admin] RBAC: Adding query filter params (role.id=43e227d04ba64588acce441d98a394f3, user.id=4c35074d21ce4c629badaf1c6b54400e, scope.system=all) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:12.113484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b0ebe-02e2-4922-95e3-9f9c91c8ac75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:12.114939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b0ebe-02e2-4922-95e3-9f9c91c8ac75 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:12.122076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940823e5-4466-4061-bb75-3e68fe6c8963 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:12.138266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 163/332] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Mar 10 17:11:11 2022] GET /identity/v3/role_assignments?user.id=4c35074d21ce4c629badaf1c6b54400e&scope.system=all&role.id=43e227d04ba64588acce441d98a394f3 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:12.157916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b030c3-e5f1-4e15-819b-1cd6ff469ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:12.158869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b030c3-e5f1-4e15-819b-1cd6ff469ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:12.159155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b030c3-e5f1-4e15-819b-1cd6ff469ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:12.159436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b030c3-e5f1-4e15-819b-1cd6ff469ba6 None admin] PATH_INFO: `/v3/users/db3c95016e2a4646ba9319c6db41fbfa` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:12.160752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b030c3-e5f1-4e15-819b-1cd6ff469ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=db3c95016e2a4646ba9319c6db41fbfa)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:12.162271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b030c3-e5f1-4e15-819b-1cd6ff469ba6 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:12.164915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 170/333] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:12 2022] GET /identity/v3/users/db3c95016e2a4646ba9319c6db41fbfa => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:12.170872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b0ebe-02e2-4922-95e3-9f9c91c8ac75 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:12.281005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b0ebe-02e2-4922-95e3-9f9c91c8ac75 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:12.318368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbb478-f511-47f6-91e6-c40c515fa6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:12.319256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbb478-f511-47f6-91e6-c40c515fa6bc None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:12.319584 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbb478-f511-47f6-91e6-c40c515fa6bc None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:12.319865 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbb478-f511-47f6-91e6-c40c515fa6bc None admin] PATH_INFO: `/v3/system/users/db3c95016e2a4646ba9319c6db41fbfa/roles/d81e3775c6c34914af06f7580faa79bf` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:12.321535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbb478-f511-47f6-91e6-c40c515fa6bc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=db3c95016e2a4646ba9319c6db41fbfa, role_id=d81e3775c6c34914af06f7580faa79bf)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:12.322985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbb478-f511-47f6-91e6-c40c515fa6bc None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:12.333688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 164/334] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Mar 10 17:11:12 2022] PUT /identity/v3/system/users/db3c95016e2a4646ba9319c6db41fbfa/roles/d81e3775c6c34914af06f7580faa79bf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:14.185319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de6e9-5152-45ce-91cd-189d7adbf2eb None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:14.185853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de6e9-5152-45ce-91cd-189d7adbf2eb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:14.185853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de6e9-5152-45ce-91cd-189d7adbf2eb None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:14.187909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 171/335] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:14.194827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdfa6-cd50-46fb-87ae-165f51f20d9f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:14.195287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdfa6-cd50-46fb-87ae-165f51f20d9f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:14.195370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdfa6-cd50-46fb-87ae-165f51f20d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:14.223127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a77cdfa6-cd50-46fb-87ae-165f51f20d9f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:14.224327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a77cdfa6-cd50-46fb-87ae-165f51f20d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:14.311893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 165/336] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:14.344614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de6e9-5152-45ce-91cd-189d7adbf2eb None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:14.467853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de6e9-5152-45ce-91cd-189d7adbf2eb None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:14.509579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1d155-0aed-470d-82db-f7d59ef3078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:14.510418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1d155-0aed-470d-82db-f7d59ef3078b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:14.510705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1d155-0aed-470d-82db-f7d59ef3078b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:14.510990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1d155-0aed-470d-82db-f7d59ef3078b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:14.527642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1d155-0aed-470d-82db-f7d59ef3078b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:14.534670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-97a1d155-0aed-470d-82db-f7d59ef3078b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:14.536054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 172/337] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:14.542373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cdfa6-cd50-46fb-87ae-165f51f20d9f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:14.665371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cdfa6-cd50-46fb-87ae-165f51f20d9f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:14.708301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82704-de7c-4a6d-adf5-132416f99304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:14.708977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82704-de7c-4a6d-adf5-132416f99304 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:14.709260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82704-de7c-4a6d-adf5-132416f99304 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:14.709536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82704-de7c-4a6d-adf5-132416f99304 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:14.710866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82704-de7c-4a6d-adf5-132416f99304 None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:14.711173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82704-de7c-4a6d-adf5-132416f99304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:14.712546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82704-de7c-4a6d-adf5-132416f99304 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:14.720977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 166/338] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:14.727134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1d155-0aed-470d-82db-f7d59ef3078b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:14.836669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1d155-0aed-470d-82db-f7d59ef3078b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:14.877837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d76d3f-664c-433f-be7f-3e71af794351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:14.878539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d76d3f-664c-433f-be7f-3e71af794351 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:14.878823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d76d3f-664c-433f-be7f-3e71af794351 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:14.879099 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d76d3f-664c-433f-be7f-3e71af794351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:14.949900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d76d3f-664c-433f-be7f-3e71af794351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:14.951437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d76d3f-664c-433f-be7f-3e71af794351 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:15.168066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 173/339] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:15.173563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82704-de7c-4a6d-adf5-132416f99304 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:15.266619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cac58-b2a3-4dc7-b556-563e0c458635 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.267143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cac58-b2a3-4dc7-b556-563e0c458635 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.267143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cac58-b2a3-4dc7-b556-563e0c458635 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.269081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 174/340] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:15.274555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97288-af2c-4a2a-9aa2-99b539d3dde6 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.274854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97288-af2c-4a2a-9aa2-99b539d3dde6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.275141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97288-af2c-4a2a-9aa2-99b539d3dde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.293216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82704-de7c-4a6d-adf5-132416f99304 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:15.315133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-faf97288-af2c-4a2a-9aa2-99b539d3dde6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:15.316344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-faf97288-af2c-4a2a-9aa2-99b539d3dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:15.334811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3f1b-789e-419b-aa10-841c94eebd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:15.335729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3f1b-789e-419b-aa10-841c94eebd7c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.336010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3f1b-789e-419b-aa10-841c94eebd7c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.336282 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3f1b-789e-419b-aa10-841c94eebd7c None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.337533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d3f1b-789e-419b-aa10-841c94eebd7c None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:15.339011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d3f1b-789e-419b-aa10-841c94eebd7c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:15.340888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 167/341] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:15 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:15.346022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3f1b-789e-419b-aa10-841c94eebd7c None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:15.418466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 175/342] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:15.420118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd6a3-fb4c-42bb-a8f8-209436638b21 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.420626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd6a3-fb4c-42bb-a8f8-209436638b21 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.421103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd6a3-fb4c-42bb-a8f8-209436638b21 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.423303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 176/343] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:15.424562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8483ce3-cd48-4f3e-94e1-3376826506b5 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.425068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8483ce3-cd48-4f3e-94e1-3376826506b5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.425550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8483ce3-cd48-4f3e-94e1-3376826506b5 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.431737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 177/344] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:15.433949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa7f5-c7af-4c21-9f08-dc275b1d966e None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.434460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa7f5-c7af-4c21-9f08-dc275b1d966e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.434935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa7f5-c7af-4c21-9f08-dc275b1d966e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.459123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3f1b-789e-419b-aa10-841c94eebd7c None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:15.461843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ebcfa7f5-c7af-4c21-9f08-dc275b1d966e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:15.463337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ebcfa7f5-c7af-4c21-9f08-dc275b1d966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:15.493811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e876550-7bfe-4df7-8df4-ac84b082bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:15.494868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e876550-7bfe-4df7-8df4-ac84b082bd41 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.494977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e876550-7bfe-4df7-8df4-ac84b082bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.495256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e876550-7bfe-4df7-8df4-ac84b082bd41 None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.503371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e876550-7bfe-4df7-8df4-ac84b082bd41 None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:15.504826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e876550-7bfe-4df7-8df4-ac84b082bd41 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:15.506940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 168/345] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:15 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:15.508413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d2d7-4221-4467-8dd4-1e8b9b27fbe2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.508538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d2d7-4221-4467-8dd4-1e8b9b27fbe2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.508718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d2d7-4221-4467-8dd4-1e8b9b27fbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.529882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-62b8d2d7-4221-4467-8dd4-1e8b9b27fbe2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:15.531112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-62b8d2d7-4221-4467-8dd4-1e8b9b27fbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:15.555361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 178/346] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:15.556096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfa7f5-c7af-4c21-9f08-dc275b1d966e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:15.610219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 169/347] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:15.611143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8d2d7-4221-4467-8dd4-1e8b9b27fbe2 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:15.657656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfa7f5-c7af-4c21-9f08-dc275b1d966e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:15.692650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5fb3a-83fc-4bb6-b221-c92c65d7f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:15.693388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5fb3a-83fc-4bb6-b221-c92c65d7f16c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.693673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5fb3a-83fc-4bb6-b221-c92c65d7f16c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.693952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5fb3a-83fc-4bb6-b221-c92c65d7f16c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.704546 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5fb3a-83fc-4bb6-b221-c92c65d7f16c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:15.711792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-65c5fb3a-83fc-4bb6-b221-c92c65d7f16c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 17:11:15.713074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 179/348] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:15.713856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5fb3a-83fc-4bb6-b221-c92c65d7f16c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:15.726738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8d2d7-4221-4467-8dd4-1e8b9b27fbe2 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:15.760549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606886d-7e4f-4471-ae9b-f9b01feb0bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:15.761206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606886d-7e4f-4471-ae9b-f9b01feb0bb8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.761493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606886d-7e4f-4471-ae9b-f9b01feb0bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.761770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606886d-7e4f-4471-ae9b-f9b01feb0bb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.762636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606886d-7e4f-4471-ae9b-f9b01feb0bb8 None admin] RBAC: Adding query filter params (group.id=bd784d726b384649922f40935bb92857, role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=55d0918683154136b5f35d663a2df767) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:15.762946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606886d-7e4f-4471-ae9b-f9b01feb0bb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:15.764369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606886d-7e4f-4471-ae9b-f9b01feb0bb8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:15.769833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 170/349] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:15 2022] GET /identity/v3/role_assignments?group.id=bd784d726b384649922f40935bb92857&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=43e227d04ba64588acce441d98a394f3 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:15.770744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606886d-7e4f-4471-ae9b-f9b01feb0bb8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:15.834256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5fb3a-83fc-4bb6-b221-c92c65d7f16c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:15.874824 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606886d-7e4f-4471-ae9b-f9b01feb0bb8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:15.888762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a1048-8446-4ce3-b411-327a6116126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:15.889586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a1048-8446-4ce3-b411-327a6116126b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.889872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a1048-8446-4ce3-b411-327a6116126b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.890167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a1048-8446-4ce3-b411-327a6116126b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.907535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a1048-8446-4ce3-b411-327a6116126b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:15.911738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a04d6-5e7e-4e7e-ae84-0c26dd8618f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:15.912554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a04d6-5e7e-4e7e-ae84-0c26dd8618f4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:15.912839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a04d6-5e7e-4e7e-ae84-0c26dd8618f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:15.913696 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a04d6-5e7e-4e7e-ae84-0c26dd8618f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:15.916057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-7b4a1048-8446-4ce3-b411-327a6116126b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:15.917671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 180/350] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:15.918616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a1048-8446-4ce3-b411-327a6116126b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:15.935663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a04d6-5e7e-4e7e-ae84-0c26dd8618f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:15.947355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-776a04d6-5e7e-4e7e-ae84-0c26dd8618f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:11:15.948528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 171/351] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:11:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:15.949391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a04d6-5e7e-4e7e-ae84-0c26dd8618f4 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:16.030431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a1048-8446-4ce3-b411-327a6116126b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:16.066082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced60d9-37aa-4085-bb41-1d35506a9e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:16.066850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced60d9-37aa-4085-bb41-1d35506a9e11 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:16.067136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced60d9-37aa-4085-bb41-1d35506a9e11 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:16.067414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced60d9-37aa-4085-bb41-1d35506a9e11 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:16.068219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced60d9-37aa-4085-bb41-1d35506a9e11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:16.068532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced60d9-37aa-4085-bb41-1d35506a9e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:16.069968 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced60d9-37aa-4085-bb41-1d35506a9e11 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:16.079120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 181/352] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:16.079990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced60d9-37aa-4085-bb41-1d35506a9e11 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:16.086136 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a04d6-5e7e-4e7e-ae84-0c26dd8618f4 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:16.122972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7260c-9956-4f37-957b-5b722f762740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:16.123639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7260c-9956-4f37-957b-5b722f762740 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:16.123923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7260c-9956-4f37-957b-5b722f762740 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:16.124197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7260c-9956-4f37-957b-5b722f762740 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:16.124953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7260c-9956-4f37-957b-5b722f762740 None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:16.125260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7260c-9956-4f37-957b-5b722f762740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:16.129132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7260c-9956-4f37-957b-5b722f762740 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:16.138134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 172/353] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:16.139031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7260c-9956-4f37-957b-5b722f762740 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:16.185772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced60d9-37aa-4085-bb41-1d35506a9e11 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:16.223605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf008a66-efcb-4948-b4d8-e7d2aabac409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:16.224300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf008a66-efcb-4948-b4d8-e7d2aabac409 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:16.224612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf008a66-efcb-4948-b4d8-e7d2aabac409 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:16.224858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf008a66-efcb-4948-b4d8-e7d2aabac409 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:16.226291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf008a66-efcb-4948-b4d8-e7d2aabac409 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:16.226644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf008a66-efcb-4948-b4d8-e7d2aabac409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:16.228125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf008a66-efcb-4948-b4d8-e7d2aabac409 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:16.237275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 182/354] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:16.239060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf008a66-efcb-4948-b4d8-e7d2aabac409 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:16.250488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7260c-9956-4f37-957b-5b722f762740 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:16.285927 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f20d2e-424a-4a8c-806a-d7a6ea9a2206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:16.286835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f20d2e-424a-4a8c-806a-d7a6ea9a2206 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:16.287116 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f20d2e-424a-4a8c-806a-d7a6ea9a2206 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:16.287393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f20d2e-424a-4a8c-806a-d7a6ea9a2206 None admin] PATH_INFO: `/v3/users/db3c95016e2a4646ba9319c6db41fbfa` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:16.288636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f20d2e-424a-4a8c-806a-d7a6ea9a2206 None admin] RBAC: Authorizing `identity:get_user(user_id=db3c95016e2a4646ba9319c6db41fbfa)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:16.292095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f20d2e-424a-4a8c-806a-d7a6ea9a2206 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:16.292095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 173/355] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:11:16 2022] GET /identity/v3/users/db3c95016e2a4646ba9319c6db41fbfa => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:16.294450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f20d2e-424a-4a8c-806a-d7a6ea9a2206 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:16.349982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf008a66-efcb-4948-b4d8-e7d2aabac409 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:16.384358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac1067-d26c-4a69-9946-76fdbd635f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:16.385071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1067-d26c-4a69-9946-76fdbd635f49 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:16.385361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1067-d26c-4a69-9946-76fdbd635f49 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:16.385641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1067-d26c-4a69-9946-76fdbd635f49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:16.396569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f20d2e-424a-4a8c-806a-d7a6ea9a2206 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:16.431582 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc016-26da-4610-8d6f-2f67371313bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:16.432239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc016-26da-4610-8d6f-2f67371313bd None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:16.432525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc016-26da-4610-8d6f-2f67371313bd None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:16.432808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc016-26da-4610-8d6f-2f67371313bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:16.457153 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac1067-d26c-4a69-9946-76fdbd635f49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:16.458651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac1067-d26c-4a69-9946-76fdbd635f49 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:16.500237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbc016-26da-4610-8d6f-2f67371313bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:16.501628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbc016-26da-4610-8d6f-2f67371313bd None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:16.559888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 183/356] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:16.560815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac1067-d26c-4a69-9946-76fdbd635f49 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:16.602189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 174/357] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:16.603129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc016-26da-4610-8d6f-2f67371313bd None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:16.669262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac1067-d26c-4a69-9946-76fdbd635f49 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:16.702821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc016-26da-4610-8d6f-2f67371313bd None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:16.705759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e3448-db6d-4d4f-b9e3-0a919d374838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:16.706465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e3448-db6d-4d4f-b9e3-0a919d374838 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:16.706761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e3448-db6d-4d4f-b9e3-0a919d374838 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:16.707033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e3448-db6d-4d4f-b9e3-0a919d374838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:16.707865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e3448-db6d-4d4f-b9e3-0a919d374838 None admin] RBAC: Adding query filter params (role.id=d81e3775c6c34914af06f7580faa79bf, user.id=db3c95016e2a4646ba9319c6db41fbfa, scope.system=all) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:16.708180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e3448-db6d-4d4f-b9e3-0a919d374838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:16.709614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e3448-db6d-4d4f-b9e3-0a919d374838 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:16.723032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 184/358] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Mar 10 17:11:16 2022] GET /identity/v3/role_assignments?user.id=db3c95016e2a4646ba9319c6db41fbfa&scope.system=all&role.id=d81e3775c6c34914af06f7580faa79bf => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:16.723933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e3448-db6d-4d4f-b9e3-0a919d374838 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:16.738264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3dac-d7ce-43b9-ad84-286aca32a8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:16.739162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3dac-d7ce-43b9-ad84-286aca32a8e0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:16.739444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3dac-d7ce-43b9-ad84-286aca32a8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:16.739723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3dac-d7ce-43b9-ad84-286aca32a8e0 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:16.742591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe3dac-d7ce-43b9-ad84-286aca32a8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:16.744160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe3dac-d7ce-43b9-ad84-286aca32a8e0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:16.746289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 175/359] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:16 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:16.755591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3dac-d7ce-43b9-ad84-286aca32a8e0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:16.942364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e3448-db6d-4d4f-b9e3-0a919d374838 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:16.963537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3dac-d7ce-43b9-ad84-286aca32a8e0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:17.001027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33323-7613-4eb8-aa15-8d1c48c587a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:17.001922 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33323-7613-4eb8-aa15-8d1c48c587a9 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.002241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33323-7613-4eb8-aa15-8d1c48c587a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.002526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33323-7613-4eb8-aa15-8d1c48c587a9 None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.003776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db33323-7613-4eb8-aa15-8d1c48c587a9 None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:17.005269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db33323-7613-4eb8-aa15-8d1c48c587a9 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:17.007358 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 176/360] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:16 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:17.008569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c5883-d407-43bf-b7ea-9d682b22c541 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.008858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c5883-d407-43bf-b7ea-9d682b22c541 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.009139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c5883-d407-43bf-b7ea-9d682b22c541 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.011026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 177/361] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:17.014309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c5883-d407-43bf-b7ea-9d682b22c541 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:17.031560 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6a438-7b9e-4e00-bfa5-2b2d959e72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:17.032442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6a438-7b9e-4e00-bfa5-2b2d959e72af None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.032720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6a438-7b9e-4e00-bfa5-2b2d959e72af None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.032996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6a438-7b9e-4e00-bfa5-2b2d959e72af None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.039319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6a438-7b9e-4e00-bfa5-2b2d959e72af None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:17.040772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6a438-7b9e-4e00-bfa5-2b2d959e72af None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:17.042869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 185/362] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:16 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:17.044067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef064d-1138-425f-8384-326c72610e61 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.044352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef064d-1138-425f-8384-326c72610e61 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.044630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef064d-1138-425f-8384-326c72610e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.072024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-5aef064d-1138-425f-8384-326c72610e61 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:17.073205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-5aef064d-1138-425f-8384-326c72610e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:17.128601 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c5883-d407-43bf-b7ea-9d682b22c541 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:17.165658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 186/363] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:17.166586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef064d-1138-425f-8384-326c72610e61 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:17.189130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e499f0-97c3-45de-a433-600ab2afeac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:17.189797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e499f0-97c3-45de-a433-600ab2afeac1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.190085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e499f0-97c3-45de-a433-600ab2afeac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.190396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e499f0-97c3-45de-a433-600ab2afeac1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.191238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e499f0-97c3-45de-a433-600ab2afeac1 None admin] RBAC: Adding query filter params (group.id=bd784d726b384649922f40935bb92857, role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:17.191549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e499f0-97c3-45de-a433-600ab2afeac1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:17.193053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e499f0-97c3-45de-a433-600ab2afeac1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:17.198932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 178/364] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:17 2022] GET /identity/v3/role_assignments?group.id=bd784d726b384649922f40935bb92857&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=43e227d04ba64588acce441d98a394f3 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:17.210984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e499f0-97c3-45de-a433-600ab2afeac1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:17.282122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef064d-1138-425f-8384-326c72610e61 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:17.322626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0a97c-eca2-4818-80bd-0569e9b8a13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:17.323507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0a97c-eca2-4818-80bd-0569e9b8a13a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.324073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0a97c-eca2-4818-80bd-0569e9b8a13a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.324358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0a97c-eca2-4818-80bd-0569e9b8a13a None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.325633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0a97c-eca2-4818-80bd-0569e9b8a13a None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:17.327661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0a97c-eca2-4818-80bd-0569e9b8a13a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:17.329862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 187/365] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:17 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:17.336414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0a97c-eca2-4818-80bd-0569e9b8a13a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:17.423859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e499f0-97c3-45de-a433-600ab2afeac1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:17.462976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a837139-2543-467e-80e4-6cd6af2d3fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:17.464240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a837139-2543-467e-80e4-6cd6af2d3fad None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.464720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a837139-2543-467e-80e4-6cd6af2d3fad None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.465196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a837139-2543-467e-80e4-6cd6af2d3fad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.467867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0a97c-eca2-4818-80bd-0569e9b8a13a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:17.478738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a837139-2543-467e-80e4-6cd6af2d3fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:17.486212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-3a837139-2543-467e-80e4-6cd6af2d3fad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:11:17.487909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 179/366] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:17.494135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197dd6-8107-45b3-be02-5e2af1f8b906 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.494439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197dd6-8107-45b3-be02-5e2af1f8b906 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.494719 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197dd6-8107-45b3-be02-5e2af1f8b906 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.496523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 180/367] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:17.497249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c197dd6-8107-45b3-be02-5e2af1f8b906 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:17.505396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85410b-a844-4389-a3d9-ddda0bf2be80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:17.506071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85410b-a844-4389-a3d9-ddda0bf2be80 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.506389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85410b-a844-4389-a3d9-ddda0bf2be80 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.506703 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85410b-a844-4389-a3d9-ddda0bf2be80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.507547 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85410b-a844-4389-a3d9-ddda0bf2be80 None admin] RBAC: Adding query filter params (group.id=bd784d726b384649922f40935bb92857, role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=55d0918683154136b5f35d663a2df767) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:17.507862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85410b-a844-4389-a3d9-ddda0bf2be80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:17.509310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85410b-a844-4389-a3d9-ddda0bf2be80 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:17.519560 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 188/368] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:17 2022] GET /identity/v3/role_assignments?group.id=bd784d726b384649922f40935bb92857&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:17.520948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5beb2e-f4d6-4fb7-9baf-db866f517bcb None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.521311 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5beb2e-f4d6-4fb7-9baf-db866f517bcb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.521670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5beb2e-f4d6-4fb7-9baf-db866f517bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.556928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ff5beb2e-f4d6-4fb7-9baf-db866f517bcb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:17.560220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ff5beb2e-f4d6-4fb7-9baf-db866f517bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:17.666314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 189/369] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:17.695590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c197dd6-8107-45b3-be02-5e2af1f8b906 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:17.706155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5beb2e-f4d6-4fb7-9baf-db866f517bcb None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:17.743238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af24a3e-29f2-4845-a2dd-4143cb87e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:17.744256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af24a3e-29f2-4845-a2dd-4143cb87e839 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.744641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af24a3e-29f2-4845-a2dd-4143cb87e839 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.744919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af24a3e-29f2-4845-a2dd-4143cb87e839 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.745672 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af24a3e-29f2-4845-a2dd-4143cb87e839 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:17.745976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af24a3e-29f2-4845-a2dd-4143cb87e839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:17.747496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af24a3e-29f2-4845-a2dd-4143cb87e839 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:17.757369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 181/370] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:17.763508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af24a3e-29f2-4845-a2dd-4143cb87e839 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:17.875355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af24a3e-29f2-4845-a2dd-4143cb87e839 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:17.912109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bbb94-f6a3-40cf-8dbf-42cda4125642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:17.912764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bbb94-f6a3-40cf-8dbf-42cda4125642 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:17.913741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bbb94-f6a3-40cf-8dbf-42cda4125642 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:17.914021 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bbb94-f6a3-40cf-8dbf-42cda4125642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:17.949751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5beb2e-f4d6-4fb7-9baf-db866f517bcb None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:17.987848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bbb94-f6a3-40cf-8dbf-42cda4125642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:17.990166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bbb94-f6a3-40cf-8dbf-42cda4125642 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:18.040198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e65bc2-197c-48cb-ab3d-2dc5250df226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:18.041340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e65bc2-197c-48cb-ab3d-2dc5250df226 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:18.041836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e65bc2-197c-48cb-ab3d-2dc5250df226 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:18.042342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e65bc2-197c-48cb-ab3d-2dc5250df226 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:18.075034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e65bc2-197c-48cb-ab3d-2dc5250df226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:18.082457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-92e65bc2-197c-48cb-ab3d-2dc5250df226 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:11:18.088638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 190/371] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:18.094624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 182/372] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:18.095344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e65bc2-197c-48cb-ab3d-2dc5250df226 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:18.103295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bbb94-f6a3-40cf-8dbf-42cda4125642 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:18.212387 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bbb94-f6a3-40cf-8dbf-42cda4125642 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:18.249113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05b522-9b93-48ea-955d-6d412a0b27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:18.249983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05b522-9b93-48ea-955d-6d412a0b27d3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:18.250314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05b522-9b93-48ea-955d-6d412a0b27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:18.250589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05b522-9b93-48ea-955d-6d412a0b27d3 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:18.251791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05b522-9b93-48ea-955d-6d412a0b27d3 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:18.253271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05b522-9b93-48ea-955d-6d412a0b27d3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:18.255331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 183/373] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:18 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:18.260702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05b522-9b93-48ea-955d-6d412a0b27d3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:18.312283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e65bc2-197c-48cb-ab3d-2dc5250df226 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:18.376792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05b522-9b93-48ea-955d-6d412a0b27d3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:18.402832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f53e5-1694-476a-b0a5-a1935467501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:18.403518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f53e5-1694-476a-b0a5-a1935467501a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:18.403807 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f53e5-1694-476a-b0a5-a1935467501a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:18.404087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f53e5-1694-476a-b0a5-a1935467501a None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:18.404841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f53e5-1694-476a-b0a5-a1935467501a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:18.405153 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f53e5-1694-476a-b0a5-a1935467501a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:18.406566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f53e5-1694-476a-b0a5-a1935467501a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:18.411555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9c737-1aba-49ce-a949-6b53b704ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:18.412412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9c737-1aba-49ce-a949-6b53b704ff00 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:18.412740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9c737-1aba-49ce-a949-6b53b704ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:18.413675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9c737-1aba-49ce-a949-6b53b704ff00 None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:18.414986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9c737-1aba-49ce-a949-6b53b704ff00 None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:18.416193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 191/374] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:18.416660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9c737-1aba-49ce-a949-6b53b704ff00 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:18.418612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 184/375] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:18 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:18.422661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f53e5-1694-476a-b0a5-a1935467501a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:18.424316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9c737-1aba-49ce-a949-6b53b704ff00 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:18.526742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9c737-1aba-49ce-a949-6b53b704ff00 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:18.533897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f53e5-1694-476a-b0a5-a1935467501a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:18.563898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4325dcb-7b3f-4014-838d-aa8d0ad2e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:18.564738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4325dcb-7b3f-4014-838d-aa8d0ad2e68e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:18.565119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4325dcb-7b3f-4014-838d-aa8d0ad2e68e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:18.565491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4325dcb-7b3f-4014-838d-aa8d0ad2e68e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:18.566451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4325dcb-7b3f-4014-838d-aa8d0ad2e68e None admin] RBAC: Adding query filter params (group.id=bd784d726b384649922f40935bb92857, role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:18.567065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4325dcb-7b3f-4014-838d-aa8d0ad2e68e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:18.568394 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4325dcb-7b3f-4014-838d-aa8d0ad2e68e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:18.572454 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546a40-b960-4885-aece-02980b5127d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:18.573304 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546a40-b960-4885-aece-02980b5127d9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:18.573736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546a40-b960-4885-aece-02980b5127d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:18.574196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546a40-b960-4885-aece-02980b5127d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:18.580032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 185/376] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:18 2022] GET /identity/v3/role_assignments?group.id=bd784d726b384649922f40935bb92857&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:18.651301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6546a40-b960-4885-aece-02980b5127d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:18.652749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6546a40-b960-4885-aece-02980b5127d9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:18.767668 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 192/377] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:18.773925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4325dcb-7b3f-4014-838d-aa8d0ad2e68e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:18.897868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4325dcb-7b3f-4014-838d-aa8d0ad2e68e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:18.940044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409c515-7409-4a09-9f38-34e847ff5068 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:18.940367 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409c515-7409-4a09-9f38-34e847ff5068 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:18.940609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409c515-7409-4a09-9f38-34e847ff5068 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:18.941978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec519d-4cf6-4a48-ac02-33d98f72b541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:18.943075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec519d-4cf6-4a48-ac02-33d98f72b541 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:18.943553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec519d-4cf6-4a48-ac02-33d98f72b541 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:18.944045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec519d-4cf6-4a48-ac02-33d98f72b541 None admin] PATH_INFO: `/v3/projects/6b6da1569d25429788d1024be5510eba` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:18.946054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec519d-4cf6-4a48-ac02-33d98f72b541 None admin] RBAC: Authorizing `identity:get_project(project_id=6b6da1569d25429788d1024be5510eba)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:18.946755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 193/378] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:18.948173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec519d-4cf6-4a48-ac02-33d98f72b541 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:18.953529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b4ce-f5d8-4e7e-a0d2-30a941d5ba7d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:18.953529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b4ce-f5d8-4e7e-a0d2-30a941d5ba7d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:18.953529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b4ce-f5d8-4e7e-a0d2-30a941d5ba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:18.954060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 186/379] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:18 2022] GET /identity/v3/projects/6b6da1569d25429788d1024be5510eba => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:18.956293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec519d-4cf6-4a48-ac02-33d98f72b541 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:18.986455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e967b4ce-f5d8-4e7e-a0d2-30a941d5ba7d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:18.987338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e967b4ce-f5d8-4e7e-a0d2-30a941d5ba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:19.067196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec519d-4cf6-4a48-ac02-33d98f72b541 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:19.106592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63186b5-1e4c-4c54-bf38-233d9d880f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:19.108152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63186b5-1e4c-4c54-bf38-233d9d880f8e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:19.108637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63186b5-1e4c-4c54-bf38-233d9d880f8e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:19.109129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63186b5-1e4c-4c54-bf38-233d9d880f8e None admin] PATH_INFO: `/v3/groups/6e64c9b777bd4799919fc08d1825b7b8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:19.114973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63186b5-1e4c-4c54-bf38-233d9d880f8e None admin] RBAC: Authorizing `identity:get_group(group_id=6e64c9b777bd4799919fc08d1825b7b8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:19.117642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63186b5-1e4c-4c54-bf38-233d9d880f8e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:19.123252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 187/380] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:18 2022] GET /identity/v3/groups/6e64c9b777bd4799919fc08d1825b7b8 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:19.126574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63186b5-1e4c-4c54-bf38-233d9d880f8e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:19.150620 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 194/381] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:19.188880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967b4ce-f5d8-4e7e-a0d2-30a941d5ba7d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:19.232296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63186b5-1e4c-4c54-bf38-233d9d880f8e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:19.270919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938411ba-75df-4e43-8936-91feef605e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:19.272440 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938411ba-75df-4e43-8936-91feef605e58 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:19.273053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938411ba-75df-4e43-8936-91feef605e58 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:19.273529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938411ba-75df-4e43-8936-91feef605e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:19.275005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938411ba-75df-4e43-8936-91feef605e58 None admin] RBAC: Adding query filter params (group.id=6e64c9b777bd4799919fc08d1825b7b8, role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=6b6da1569d25429788d1024be5510eba) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:19.275548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938411ba-75df-4e43-8936-91feef605e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:19.277185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938411ba-75df-4e43-8936-91feef605e58 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:19.290377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 188/382] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:19 2022] GET /identity/v3/role_assignments?group.id=6e64c9b777bd4799919fc08d1825b7b8&scope.project.id=6b6da1569d25429788d1024be5510eba&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:19.346278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967b4ce-f5d8-4e7e-a0d2-30a941d5ba7d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:19.382441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c156d-5eec-47dc-a2e1-88493146cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:19.383264 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c156d-5eec-47dc-a2e1-88493146cece None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:19.383545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c156d-5eec-47dc-a2e1-88493146cece None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:19.383818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c156d-5eec-47dc-a2e1-88493146cece None admin] PATH_INFO: `/v3/roles/member` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:19.400749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c156d-5eec-47dc-a2e1-88493146cece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:19.408111 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-238c156d-5eec-47dc-a2e1-88493146cece None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:19.409781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 195/383] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:19.415931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938411ba-75df-4e43-8936-91feef605e58 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:19.527933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938411ba-75df-4e43-8936-91feef605e58 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:19.567711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e34cb-2a7f-4a32-b7d1-18ede623f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:19.568431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e34cb-2a7f-4a32-b7d1-18ede623f10a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:19.568715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e34cb-2a7f-4a32-b7d1-18ede623f10a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:19.568990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e34cb-2a7f-4a32-b7d1-18ede623f10a None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:19.569775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e34cb-2a7f-4a32-b7d1-18ede623f10a None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:19.570079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e34cb-2a7f-4a32-b7d1-18ede623f10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:19.571484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e34cb-2a7f-4a32-b7d1-18ede623f10a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:19.580102 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 189/384] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:19.585962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c156d-5eec-47dc-a2e1-88493146cece None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:19.698406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c156d-5eec-47dc-a2e1-88493146cece None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:19.736253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01fd6c-bc1e-4734-89a3-dc96b9bdd213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:19.737116 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01fd6c-bc1e-4734-89a3-dc96b9bdd213 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:19.737396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01fd6c-bc1e-4734-89a3-dc96b9bdd213 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:19.737671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01fd6c-bc1e-4734-89a3-dc96b9bdd213 None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:19.738863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01fd6c-bc1e-4734-89a3-dc96b9bdd213 None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:19.740290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01fd6c-bc1e-4734-89a3-dc96b9bdd213 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:19.742296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 196/385] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:19 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:19.747936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e34cb-2a7f-4a32-b7d1-18ede623f10a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:19.864921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e34cb-2a7f-4a32-b7d1-18ede623f10a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:19.898651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7e90d-ccba-40b2-a9dc-f2375c930341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:19.899509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e90d-ccba-40b2-a9dc-f2375c930341 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:19.899785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e90d-ccba-40b2-a9dc-f2375c930341 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:19.900112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e90d-ccba-40b2-a9dc-f2375c930341 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:19.901346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7e90d-ccba-40b2-a9dc-f2375c930341 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:19.902829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7e90d-ccba-40b2-a9dc-f2375c930341 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:19.904720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 190/386] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:19 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:19.910973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01fd6c-bc1e-4734-89a3-dc96b9bdd213 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:20.044467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01fd6c-bc1e-4734-89a3-dc96b9bdd213 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:20.088906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c47f6-5dca-4c92-a190-c3a2ae5805f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:20.089801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c47f6-5dca-4c92-a190-c3a2ae5805f2 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:20.090085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c47f6-5dca-4c92-a190-c3a2ae5805f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:20.090392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c47f6-5dca-4c92-a190-c3a2ae5805f2 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767/groups/bd784d726b384649922f40935bb92857/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:20.095214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c47f6-5dca-4c92-a190-c3a2ae5805f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d0918683154136b5f35d663a2df767, group_id=bd784d726b384649922f40935bb92857, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:20.096660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c47f6-5dca-4c92-a190-c3a2ae5805f2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:20.113194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 197/387] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Mar 10 17:11:19 2022] PUT /identity/v3/projects/55d0918683154136b5f35d663a2df767/groups/bd784d726b384649922f40935bb92857/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:11:20.462086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1cf5-e4ba-4c93-b881-fa10ef08b65d None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:20.462484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1cf5-e4ba-4c93-b881-fa10ef08b65d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:20.462660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1cf5-e4ba-4c93-b881-fa10ef08b65d None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:20.464859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 191/388] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:20.470201 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f27c-771b-4ae8-a90f-c8ad7a50aaa4 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:20.470741 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f27c-771b-4ae8-a90f-c8ad7a50aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:20.471247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f27c-771b-4ae8-a90f-c8ad7a50aaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:20.495122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-3fd7f27c-771b-4ae8-a90f-c8ad7a50aaa4 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:20.496643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3fd7f27c-771b-4ae8-a90f-c8ad7a50aaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:20.584452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 198/389] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:20.608241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b1cf5-e4ba-4c93-b881-fa10ef08b65d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:20.720689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b1cf5-e4ba-4c93-b881-fa10ef08b65d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:20.766831 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b130d0-eb4e-4748-819e-ffc590b17861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:20.768024 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b130d0-eb4e-4748-819e-ffc590b17861 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:20.768578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b130d0-eb4e-4748-819e-ffc590b17861 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:20.769053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b130d0-eb4e-4748-819e-ffc590b17861 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:20.783488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b130d0-eb4e-4748-819e-ffc590b17861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:20.791405 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-b2b130d0-eb4e-4748-819e-ffc590b17861 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:11:20.792877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 192/390] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:11:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:20.799206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7f27c-771b-4ae8-a90f-c8ad7a50aaa4 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:20.905390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7f27c-771b-4ae8-a90f-c8ad7a50aaa4 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:20.950414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc2136-bcf1-4afa-845b-3e88bf523e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:20.951485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2136-bcf1-4afa-845b-3e88bf523e86 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:20.951971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2136-bcf1-4afa-845b-3e88bf523e86 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:20.952449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2136-bcf1-4afa-845b-3e88bf523e86 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:20.953399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc2136-bcf1-4afa-845b-3e88bf523e86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:20.953920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc2136-bcf1-4afa-845b-3e88bf523e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:20.955577 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc2136-bcf1-4afa-845b-3e88bf523e86 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:20.965115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 199/391] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:20.971028 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b130d0-eb4e-4748-819e-ffc590b17861 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:21.102832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b130d0-eb4e-4748-819e-ffc590b17861 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:21.120859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b2763-6696-49c5-8625-d69749e44b32 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.121473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b2763-6696-49c5-8625-d69749e44b32 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.121950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b2763-6696-49c5-8625-d69749e44b32 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.124186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 200/392] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:21.137199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7722104-ca3a-44fe-b6ca-d5b7e962a4ee None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.137812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7722104-ca3a-44fe-b6ca-d5b7e962a4ee None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.137931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f70463-bf16-461e-a91e-76b91aa1b580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:21.138458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7722104-ca3a-44fe-b6ca-d5b7e962a4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.138711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f70463-bf16-461e-a91e-76b91aa1b580 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.138996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f70463-bf16-461e-a91e-76b91aa1b580 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.139273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f70463-bf16-461e-a91e-76b91aa1b580 None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.140476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f70463-bf16-461e-a91e-76b91aa1b580 None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:21.143790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f70463-bf16-461e-a91e-76b91aa1b580 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:21.144145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 193/393] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:20 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:21.150087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f70463-bf16-461e-a91e-76b91aa1b580 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:21.175233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e7722104-ca3a-44fe-b6ca-d5b7e962a4ee None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:21.176793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e7722104-ca3a-44fe-b6ca-d5b7e962a4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:21.251817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f70463-bf16-461e-a91e-76b91aa1b580 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:21.276424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 201/394] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:21.285654 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c73b51-cd1c-4ec2-87c2-7fd21dabeef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:21.286546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c73b51-cd1c-4ec2-87c2-7fd21dabeef4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.286831 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c73b51-cd1c-4ec2-87c2-7fd21dabeef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.287110 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c73b51-cd1c-4ec2-87c2-7fd21dabeef4 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.288352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c73b51-cd1c-4ec2-87c2-7fd21dabeef4 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:21.291461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c73b51-cd1c-4ec2-87c2-7fd21dabeef4 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:21.291461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 194/395] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:21 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:21.297560 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7722104-ca3a-44fe-b6ca-d5b7e962a4ee None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:21.321121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c73b51-cd1c-4ec2-87c2-7fd21dabeef4 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:21.428195 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c73b51-cd1c-4ec2-87c2-7fd21dabeef4 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:21.462253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0c87-df72-4eb6-94d6-a768aeb276df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:21.463058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0c87-df72-4eb6-94d6-a768aeb276df None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.463344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0c87-df72-4eb6-94d6-a768aeb276df None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.463622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0c87-df72-4eb6-94d6-a768aeb276df None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.474231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f0c87-df72-4eb6-94d6-a768aeb276df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:21.481797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-d63f0c87-df72-4eb6-94d6-a768aeb276df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:21.483393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 195/396] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:21.490142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0c87-df72-4eb6-94d6-a768aeb276df None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:21.530048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7722104-ca3a-44fe-b6ca-d5b7e962a4ee None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:21.594796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593bcce-bae6-491b-b16f-f256b202c744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:21.595846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593bcce-bae6-491b-b16f-f256b202c744 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.596131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593bcce-bae6-491b-b16f-f256b202c744 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.596406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593bcce-bae6-491b-b16f-f256b202c744 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767/groups/bd784d726b384649922f40935bb92857/roles/59b67f94d2af48b08b7bef41a8396bfb` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.599247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593bcce-bae6-491b-b16f-f256b202c744 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d0918683154136b5f35d663a2df767, group_id=bd784d726b384649922f40935bb92857, role_id=59b67f94d2af48b08b7bef41a8396bfb)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:21.602017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593bcce-bae6-491b-b16f-f256b202c744 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:21.624193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 202/397] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Mar 10 17:11:21 2022] PUT /identity/v3/projects/55d0918683154136b5f35d663a2df767/groups/bd784d726b384649922f40935bb92857/roles/59b67f94d2af48b08b7bef41a8396bfb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:21.625567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa6123-2a65-49d0-8d7c-48b3da20e1d4 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.625879 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa6123-2a65-49d0-8d7c-48b3da20e1d4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.626169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa6123-2a65-49d0-8d7c-48b3da20e1d4 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.628219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 203/398] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:21.634948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72dc95-c24d-461e-bf62-0282290cac8d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.635325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72dc95-c24d-461e-bf62-0282290cac8d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.635755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72dc95-c24d-461e-bf62-0282290cac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.659249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-2b72dc95-c24d-461e-bf62-0282290cac8d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:21.660536 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2b72dc95-c24d-461e-bf62-0282290cac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:21.663767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0c87-df72-4eb6-94d6-a768aeb276df None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:21.743785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 204/399] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:21.744423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d177a-9f32-49bd-87f2-c73fd7ac2855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:21.745175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d177a-9f32-49bd-87f2-c73fd7ac2855 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.745468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d177a-9f32-49bd-87f2-c73fd7ac2855 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.745747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d177a-9f32-49bd-87f2-c73fd7ac2855 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.746610 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d177a-9f32-49bd-87f2-c73fd7ac2855 None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:21.746925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d177a-9f32-49bd-87f2-c73fd7ac2855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:21.748319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d177a-9f32-49bd-87f2-c73fd7ac2855 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:21.765975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 196/400] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:21.768757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72dc95-c24d-461e-bf62-0282290cac8d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:21.772091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d177a-9f32-49bd-87f2-c73fd7ac2855 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:21.886273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72dc95-c24d-461e-bf62-0282290cac8d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:21.925045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac30a1-de33-4d9f-9034-2ea1f2e3af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:21.925876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac30a1-de33-4d9f-9034-2ea1f2e3af61 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:21.926162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac30a1-de33-4d9f-9034-2ea1f2e3af61 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:21.926594 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac30a1-de33-4d9f-9034-2ea1f2e3af61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:21.939235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac30a1-de33-4d9f-9034-2ea1f2e3af61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:21.948750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-6eac30a1-de33-4d9f-9034-2ea1f2e3af61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:11:21.950783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 205/401] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:11:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:21.957263 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac30a1-de33-4d9f-9034-2ea1f2e3af61 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:21.992783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d177a-9f32-49bd-87f2-c73fd7ac2855 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:22.036904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a644a5-0b78-45c8-a580-051278865ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:22.037684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a644a5-0b78-45c8-a580-051278865ff1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.038000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a644a5-0b78-45c8-a580-051278865ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.038476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a644a5-0b78-45c8-a580-051278865ff1 None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.040160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a644a5-0b78-45c8-a580-051278865ff1 None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:22.041615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a644a5-0b78-45c8-a580-051278865ff1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:22.044124 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 197/402] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:21 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:22.049443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a644a5-0b78-45c8-a580-051278865ff1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:22.080764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac30a1-de33-4d9f-9034-2ea1f2e3af61 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:22.176029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e62d-e4ee-4628-a8c5-799bdac39c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:22.176722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e62d-e4ee-4628-a8c5-799bdac39c9b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.177003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e62d-e4ee-4628-a8c5-799bdac39c9b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.177281 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e62d-e4ee-4628-a8c5-799bdac39c9b None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.178045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e62d-e4ee-4628-a8c5-799bdac39c9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:22.179713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e62d-e4ee-4628-a8c5-799bdac39c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:22.181114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e62d-e4ee-4628-a8c5-799bdac39c9b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:22.197277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a644a5-0b78-45c8-a580-051278865ff1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:22.200084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 206/403] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:22.205352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e62d-e4ee-4628-a8c5-799bdac39c9b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:22.258822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709c8ac-6f81-4f3a-9d06-5c75149247f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:22.259703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709c8ac-6f81-4f3a-9d06-5c75149247f0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.259988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709c8ac-6f81-4f3a-9d06-5c75149247f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.260263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709c8ac-6f81-4f3a-9d06-5c75149247f0 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.261509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709c8ac-6f81-4f3a-9d06-5c75149247f0 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:22.262979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709c8ac-6f81-4f3a-9d06-5c75149247f0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:22.264977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 198/404] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:22 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:22.270509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709c8ac-6f81-4f3a-9d06-5c75149247f0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:22.313387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e62d-e4ee-4628-a8c5-799bdac39c9b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:22.347085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6c87-c0a8-4d04-bf08-e81e67fd57c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:22.347948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6c87-c0a8-4d04-bf08-e81e67fd57c9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.348230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6c87-c0a8-4d04-bf08-e81e67fd57c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.348503 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6c87-c0a8-4d04-bf08-e81e67fd57c9 None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.349690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb6c87-c0a8-4d04-bf08-e81e67fd57c9 None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:22.351707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb6c87-c0a8-4d04-bf08-e81e67fd57c9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:22.354378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 207/405] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:22 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:22.359341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6c87-c0a8-4d04-bf08-e81e67fd57c9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:22.466317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6c87-c0a8-4d04-bf08-e81e67fd57c9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:22.468263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709c8ac-6f81-4f3a-9d06-5c75149247f0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:22.502704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490f58b-ef8f-46c8-899d-52a3d794b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:22.503584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490f58b-ef8f-46c8-899d-52a3d794b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.503870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490f58b-ef8f-46c8-899d-52a3d794b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.504147 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490f58b-ef8f-46c8-899d-52a3d794b6a7 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.505321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490f58b-ef8f-46c8-899d-52a3d794b6a7 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:22.506812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490f58b-ef8f-46c8-899d-52a3d794b6a7 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:22.508482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 208/406] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:22 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:22.514348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490f58b-ef8f-46c8-899d-52a3d794b6a7 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:22.519379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80065291-622d-4147-9d32-330cef45bfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:22.520283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80065291-622d-4147-9d32-330cef45bfb7 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.520567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80065291-622d-4147-9d32-330cef45bfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.520843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80065291-622d-4147-9d32-330cef45bfb7 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/groups/bd784d726b384649922f40935bb92857/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.527448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80065291-622d-4147-9d32-330cef45bfb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080, group_id=bd784d726b384649922f40935bb92857, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:22.528898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80065291-622d-4147-9d32-330cef45bfb7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:22.552395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 199/407] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Mar 10 17:11:22 2022] PUT /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/groups/bd784d726b384649922f40935bb92857/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:11:22.634850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633d896-6487-4d1b-bb6a-abe8e72664e4 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.635028 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633d896-6487-4d1b-bb6a-abe8e72664e4 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.635312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633d896-6487-4d1b-bb6a-abe8e72664e4 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.637088 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 200/408] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:22.643646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee7127-b2cc-4a02-a806-0b7f7bd47266 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.643931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee7127-b2cc-4a02-a806-0b7f7bd47266 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.644195 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee7127-b2cc-4a02-a806-0b7f7bd47266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.675274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-98ee7127-b2cc-4a02-a806-0b7f7bd47266 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:22.676483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-98ee7127-b2cc-4a02-a806-0b7f7bd47266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:22.722541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490f58b-ef8f-46c8-899d-52a3d794b6a7 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:22.777541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f81e9-de33-4941-9949-42ebe001a105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:22.778412 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f81e9-de33-4941-9949-42ebe001a105 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.778706 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f81e9-de33-4941-9949-42ebe001a105 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.778968 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f81e9-de33-4941-9949-42ebe001a105 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/groups/bd784d726b384649922f40935bb92857/roles/59b67f94d2af48b08b7bef41a8396bfb` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.785599 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f81e9-de33-4941-9949-42ebe001a105 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080, group_id=bd784d726b384649922f40935bb92857, role_id=59b67f94d2af48b08b7bef41a8396bfb)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:22.787084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f81e9-de33-4941-9949-42ebe001a105 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:22.791407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 201/409] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:22.812903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 209/410] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Mar 10 17:11:22 2022] PUT /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080/groups/bd784d726b384649922f40935bb92857/roles/59b67f94d2af48b08b7bef41a8396bfb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:11:22.819076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee7127-b2cc-4a02-a806-0b7f7bd47266 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:22.934271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee7127-b2cc-4a02-a806-0b7f7bd47266 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:22.970919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea898-6827-473f-a3e6-aaecbd21da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:22.971745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea898-6827-473f-a3e6-aaecbd21da0e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:22.972020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea898-6827-473f-a3e6-aaecbd21da0e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:22.972296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea898-6827-473f-a3e6-aaecbd21da0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:22.984246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeea898-6827-473f-a3e6-aaecbd21da0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:22.991607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-ffeea898-6827-473f-a3e6-aaecbd21da0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:11:22.993072 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 202/411] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:22.999203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f81e9-de33-4941-9949-42ebe001a105 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:23.136070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f81e9-de33-4941-9949-42ebe001a105 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:23.173234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbdfc1-05a7-4566-aab1-d980e698b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:23.173916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbdfc1-05a7-4566-aab1-d980e698b483 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:23.174243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbdfc1-05a7-4566-aab1-d980e698b483 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:23.174526 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbdfc1-05a7-4566-aab1-d980e698b483 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:23.175275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbdfc1-05a7-4566-aab1-d980e698b483 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:23.175584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbdfc1-05a7-4566-aab1-d980e698b483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:23.176958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbdfc1-05a7-4566-aab1-d980e698b483 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:23.186389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 210/412] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:23.192092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea898-6827-473f-a3e6-aaecbd21da0e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:23.282583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb1bd1-203e-4d02-b485-55b36d758dd0 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:23.283215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb1bd1-203e-4d02-b485-55b36d758dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:23.283695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb1bd1-203e-4d02-b485-55b36d758dd0 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:23.285927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 211/413] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:23.292788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9089cb-5ef4-4db8-b050-df29ea682b52 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:23.292788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9089cb-5ef4-4db8-b050-df29ea682b52 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:23.292788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9089cb-5ef4-4db8-b050-df29ea682b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:23.302228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea898-6827-473f-a3e6-aaecbd21da0e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:23.338074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8948-f599-4fc5-ad11-21c3b4cdd9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:23.338961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8948-f599-4fc5-ad11-21c3b4cdd9e6 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:23.339241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8948-f599-4fc5-ad11-21c3b4cdd9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:23.339514 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8948-f599-4fc5-ad11-21c3b4cdd9e6 None admin] PATH_INFO: `/v3/groups/6e64c9b777bd4799919fc08d1825b7b8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:23.339929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-aa9089cb-5ef4-4db8-b050-df29ea682b52 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:23.340686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d8948-f599-4fc5-ad11-21c3b4cdd9e6 None admin] RBAC: Authorizing `identity:get_group(group_id=6e64c9b777bd4799919fc08d1825b7b8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:23.341544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-aa9089cb-5ef4-4db8-b050-df29ea682b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:23.342125 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d8948-f599-4fc5-ad11-21c3b4cdd9e6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:23.348181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 203/414] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:23 2022] GET /identity/v3/groups/6e64c9b777bd4799919fc08d1825b7b8 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:23.349463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8948-f599-4fc5-ad11-21c3b4cdd9e6 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:23.459850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8948-f599-4fc5-ad11-21c3b4cdd9e6 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:23.489447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 212/415] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:23.495723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa6e7a-e13f-41ce-bd28-333934c06cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:23.496642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa6e7a-e13f-41ce-bd28-333934c06cc3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:23.496925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa6e7a-e13f-41ce-bd28-333934c06cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:23.497199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa6e7a-e13f-41ce-bd28-333934c06cc3 None admin] PATH_INFO: `/v3/projects/6b6da1569d25429788d1024be5510eba` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:23.498422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa6e7a-e13f-41ce-bd28-333934c06cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=6b6da1569d25429788d1024be5510eba)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:23.499869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa6e7a-e13f-41ce-bd28-333934c06cc3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:23.506289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 204/416] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:23 2022] GET /identity/v3/projects/6b6da1569d25429788d1024be5510eba => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:23.508223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9089cb-5ef4-4db8-b050-df29ea682b52 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:23.547133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa6e7a-e13f-41ce-bd28-333934c06cc3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:23.625260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9089cb-5ef4-4db8-b050-df29ea682b52 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:23.658800 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e8c42-c44d-4157-99c1-1d0fd7b185af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:23.659701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e8c42-c44d-4157-99c1-1d0fd7b185af None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:23.659987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e8c42-c44d-4157-99c1-1d0fd7b185af None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:23.660268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e8c42-c44d-4157-99c1-1d0fd7b185af None admin] PATH_INFO: `/v3/projects/6b6da1569d25429788d1024be5510eba/groups/6e64c9b777bd4799919fc08d1825b7b8/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:23.662255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e8c42-c44d-4157-99c1-1d0fd7b185af None admin] RBAC: Authorizing `identity:create_grant(project_id=6b6da1569d25429788d1024be5510eba, group_id=6e64c9b777bd4799919fc08d1825b7b8, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:23.663743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e8c42-c44d-4157-99c1-1d0fd7b185af None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:23.683416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 213/417] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Mar 10 17:11:23 2022] PUT /identity/v3/projects/6b6da1569d25429788d1024be5510eba/groups/6e64c9b777bd4799919fc08d1825b7b8/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:23.693795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa6e7a-e13f-41ce-bd28-333934c06cc3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:23.735347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66997331-e34f-433b-b590-4278ab9f5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:23.736220 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66997331-e34f-433b-b590-4278ab9f5772 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:23.736510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66997331-e34f-433b-b590-4278ab9f5772 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:23.736788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66997331-e34f-433b-b590-4278ab9f5772 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:23.749536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66997331-e34f-433b-b590-4278ab9f5772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:23.757211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-66997331-e34f-433b-b590-4278ab9f5772 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:23.758996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 205/418] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:23.764979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e8c42-c44d-4157-99c1-1d0fd7b185af None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:23.871494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e8c42-c44d-4157-99c1-1d0fd7b185af None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:23.907816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f5425-1dcc-4824-b746-4adde50a2d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:23.908510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f5425-1dcc-4824-b746-4adde50a2d22 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:23.908800 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f5425-1dcc-4824-b746-4adde50a2d22 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:23.909083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f5425-1dcc-4824-b746-4adde50a2d22 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:23.909842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f5425-1dcc-4824-b746-4adde50a2d22 None admin] RBAC: Adding query filter params (name=member) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:23.910190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f5425-1dcc-4824-b746-4adde50a2d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:23.911659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f5425-1dcc-4824-b746-4adde50a2d22 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:23.921257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 214/419] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:23.927123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66997331-e34f-433b-b590-4278ab9f5772 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:24.033799 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66997331-e34f-433b-b590-4278ab9f5772 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:24.069558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeb458-292e-403f-ba70-122c70333b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:24.070311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb458-292e-403f-ba70-122c70333b2f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:24.070595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb458-292e-403f-ba70-122c70333b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:24.070874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb458-292e-403f-ba70-122c70333b2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:24.142371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeb458-292e-403f-ba70-122c70333b2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:24.143830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeb458-292e-403f-ba70-122c70333b2f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:24.251989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 206/420] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:24.259212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f5425-1dcc-4824-b746-4adde50a2d22 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:24.371908 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f5425-1dcc-4824-b746-4adde50a2d22 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:24.405393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927b12e-6990-43e3-9518-0fdc37dd4f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:24.406554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927b12e-6990-43e3-9518-0fdc37dd4f5b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:24.407067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927b12e-6990-43e3-9518-0fdc37dd4f5b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:24.407506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927b12e-6990-43e3-9518-0fdc37dd4f5b None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:24.408830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927b12e-6990-43e3-9518-0fdc37dd4f5b None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:24.410428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927b12e-6990-43e3-9518-0fdc37dd4f5b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:24.412571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 215/421] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:24 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:24.418307 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeb458-292e-403f-ba70-122c70333b2f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:24.523270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeb458-292e-403f-ba70-122c70333b2f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:24.557323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b8af1-2e72-4465-86e1-baf77e994c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:24.558432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b8af1-2e72-4465-86e1-baf77e994c30 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:24.558889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b8af1-2e72-4465-86e1-baf77e994c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:24.559312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b8af1-2e72-4465-86e1-baf77e994c30 None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:24.560678 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b8af1-2e72-4465-86e1-baf77e994c30 None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:24.562333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b8af1-2e72-4465-86e1-baf77e994c30 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:24.564395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 207/422] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:24 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:24.570593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927b12e-6990-43e3-9518-0fdc37dd4f5b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:24.673769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c5839-de74-4636-a805-821eff448bf5 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:24.674313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c5839-de74-4636-a805-821eff448bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:24.674739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c5839-de74-4636-a805-821eff448bf5 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:24.676658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 208/423] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:24.677465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927b12e-6990-43e3-9518-0fdc37dd4f5b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:24.682340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffaa56-e821-4d2f-9043-942b6e04506f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:24.682846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffaa56-e821-4d2f-9043-942b6e04506f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:24.683270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffaa56-e821-4d2f-9043-942b6e04506f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:24.707249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bbffaa56-e821-4d2f-9043-942b6e04506f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:24.710371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bbffaa56-e821-4d2f-9043-942b6e04506f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:24.756358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6285f-dfcd-42e1-b38a-0b3f48c1cd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:24.757902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6285f-dfcd-42e1-b38a-0b3f48c1cd53 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:24.758369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6285f-dfcd-42e1-b38a-0b3f48c1cd53 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:24.758779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6285f-dfcd-42e1-b38a-0b3f48c1cd53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:24.760094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6285f-dfcd-42e1-b38a-0b3f48c1cd53 None admin] RBAC: Adding query filter params (group.id=bd784d726b384649922f40935bb92857, role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=55d0918683154136b5f35d663a2df767) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:24.760568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6285f-dfcd-42e1-b38a-0b3f48c1cd53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:24.770096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6285f-dfcd-42e1-b38a-0b3f48c1cd53 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:24.785225 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 216/424] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:24 2022] GET /identity/v3/role_assignments?group.id=bd784d726b384649922f40935bb92857&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=43e227d04ba64588acce441d98a394f3 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:24.806242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 209/425] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:24.851776 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6285f-dfcd-42e1-b38a-0b3f48c1cd53 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:24.988239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6285f-dfcd-42e1-b38a-0b3f48c1cd53 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:25.027318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13a71-3a06-48ea-90e7-1308060d81b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:25.028137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13a71-3a06-48ea-90e7-1308060d81b2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:25.028421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13a71-3a06-48ea-90e7-1308060d81b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:25.028698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13a71-3a06-48ea-90e7-1308060d81b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:25.042916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a13a71-3a06-48ea-90e7-1308060d81b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:25.050621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-90a13a71-3a06-48ea-90e7-1308060d81b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:11:25.052123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 217/426] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:11:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:25.058093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffaa56-e821-4d2f-9043-942b6e04506f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:25.169351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffaa56-e821-4d2f-9043-942b6e04506f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:25.216119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357d062-de03-46ba-8b20-769a12dd20e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:25.217152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357d062-de03-46ba-8b20-769a12dd20e6 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:25.217641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357d062-de03-46ba-8b20-769a12dd20e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:25.218170 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357d062-de03-46ba-8b20-769a12dd20e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:25.219130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357d062-de03-46ba-8b20-769a12dd20e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:25.219651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357d062-de03-46ba-8b20-769a12dd20e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:25.221216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357d062-de03-46ba-8b20-769a12dd20e6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:25.232009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 210/427] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:25.237356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13a71-3a06-48ea-90e7-1308060d81b2 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:25.361637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13a71-3a06-48ea-90e7-1308060d81b2 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:25.398510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab45e9-4543-414c-816d-3f15e9383cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:25.399585 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab45e9-4543-414c-816d-3f15e9383cad None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:25.400092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab45e9-4543-414c-816d-3f15e9383cad None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:25.400596 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab45e9-4543-414c-816d-3f15e9383cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:25.472727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab45e9-4543-414c-816d-3f15e9383cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:25.474582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab45e9-4543-414c-816d-3f15e9383cad None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:25.509381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cea105-dcda-457a-8de6-1a126b317efb None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:25.509699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cea105-dcda-457a-8de6-1a126b317efb None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:25.510010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cea105-dcda-457a-8de6-1a126b317efb None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:25.512196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 211/428] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:25.517488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4427e-d99b-492c-a42f-6e8fa1b5b059 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:25.518008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4427e-d99b-492c-a42f-6e8fa1b5b059 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:25.518515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4427e-d99b-492c-a42f-6e8fa1b5b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:25.538029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a7d4427e-d99b-492c-a42f-6e8fa1b5b059 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:25.539585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a7d4427e-d99b-492c-a42f-6e8fa1b5b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:25.613124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 218/429] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:25.613318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 212/430] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:25.616771 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab45e9-4543-414c-816d-3f15e9383cad None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:25.647340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4427e-d99b-492c-a42f-6e8fa1b5b059 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:25.753825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab45e9-4543-414c-816d-3f15e9383cad None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:25.766327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4427e-d99b-492c-a42f-6e8fa1b5b059 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:25.805076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465900ee-2af2-4f52-aa1a-218fcb913005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:25.806320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465900ee-2af2-4f52-aa1a-218fcb913005 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:25.806877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465900ee-2af2-4f52-aa1a-218fcb913005 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:25.807401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465900ee-2af2-4f52-aa1a-218fcb913005 None admin] PATH_INFO: `/v3/projects/55d0918683154136b5f35d663a2df767` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:25.808780 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465900ee-2af2-4f52-aa1a-218fcb913005 None admin] RBAC: Authorizing `identity:get_project(project_id=55d0918683154136b5f35d663a2df767)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:25.810418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465900ee-2af2-4f52-aa1a-218fcb913005 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:25.812654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 219/431] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:25 2022] GET /identity/v3/projects/55d0918683154136b5f35d663a2df767 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:25.817553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c28ca-3e6f-4c6d-9993-daa10e7fa231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:25.818713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465900ee-2af2-4f52-aa1a-218fcb913005 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:25.820793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c28ca-3e6f-4c6d-9993-daa10e7fa231 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:25.821079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c28ca-3e6f-4c6d-9993-daa10e7fa231 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:25.821352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c28ca-3e6f-4c6d-9993-daa10e7fa231 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:25.841599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c28ca-3e6f-4c6d-9993-daa10e7fa231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:25.851588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-928c28ca-3e6f-4c6d-9993-daa10e7fa231 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 17:11:25.857114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 213/432] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:25.859172 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c28ca-3e6f-4c6d-9993-daa10e7fa231 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:25.943484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465900ee-2af2-4f52-aa1a-218fcb913005 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:25.981777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c28ca-3e6f-4c6d-9993-daa10e7fa231 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:25.986577 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6baf1-d5b1-40d5-bd1b-54cf0f7e33bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:25.987441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6baf1-d5b1-40d5-bd1b-54cf0f7e33bd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:25.987721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6baf1-d5b1-40d5-bd1b-54cf0f7e33bd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:25.987992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6baf1-d5b1-40d5-bd1b-54cf0f7e33bd None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:25.989664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6baf1-d5b1-40d5-bd1b-54cf0f7e33bd None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:25.992056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6baf1-d5b1-40d5-bd1b-54cf0f7e33bd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:25.994565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 220/433] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:25 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:26.001541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6baf1-d5b1-40d5-bd1b-54cf0f7e33bd None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:26.020842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7c112-932d-45e4-960b-0c1676571a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:26.021437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c112-932d-45e4-960b-0c1676571a4c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.021721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c112-932d-45e4-960b-0c1676571a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.021998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c112-932d-45e4-960b-0c1676571a4c None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.022809 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c112-932d-45e4-960b-0c1676571a4c None admin] RBAC: Adding query filter params (name=member) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:26.023113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c112-932d-45e4-960b-0c1676571a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:26.024483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c112-932d-45e4-960b-0c1676571a4c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:26.033273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 214/434] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:11:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:26.039062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7c112-932d-45e4-960b-0c1676571a4c None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:26.119462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6baf1-d5b1-40d5-bd1b-54cf0f7e33bd None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:26.140450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7c112-932d-45e4-960b-0c1676571a4c None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:26.151111 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d80f8-12b6-446b-99b7-c8fc786e790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:26.151774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d80f8-12b6-446b-99b7-c8fc786e790c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.152058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d80f8-12b6-446b-99b7-c8fc786e790c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.152336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d80f8-12b6-446b-99b7-c8fc786e790c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.153160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d80f8-12b6-446b-99b7-c8fc786e790c None admin] RBAC: Adding query filter params (group.id=bd784d726b384649922f40935bb92857, role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=55d0918683154136b5f35d663a2df767) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:26.153474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d80f8-12b6-446b-99b7-c8fc786e790c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:26.154914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d80f8-12b6-446b-99b7-c8fc786e790c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:26.170133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 221/435] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/role_assignments?group.id=bd784d726b384649922f40935bb92857&scope.project.id=55d0918683154136b5f35d663a2df767&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:26.170133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bba45-72ea-46f6-b19e-57b9cd775314 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.170133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bba45-72ea-46f6-b19e-57b9cd775314 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.170133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bba45-72ea-46f6-b19e-57b9cd775314 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.170133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 222/436] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:26.170133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce48865-335d-48cb-be7e-5e025c4fe56b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.170674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce48865-335d-48cb-be7e-5e025c4fe56b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.170674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce48865-335d-48cb-be7e-5e025c4fe56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.184848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257b6d0-b356-4a1c-8870-f30d48a4c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:26.185571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257b6d0-b356-4a1c-8870-f30d48a4c157 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.185861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257b6d0-b356-4a1c-8870-f30d48a4c157 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.186176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257b6d0-b356-4a1c-8870-f30d48a4c157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.190994 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-1ce48865-335d-48cb-be7e-5e025c4fe56b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:26.192198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1ce48865-335d-48cb-be7e-5e025c4fe56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:26.264908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257b6d0-b356-4a1c-8870-f30d48a4c157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:26.266465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257b6d0-b356-4a1c-8870-f30d48a4c157 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:26.288228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 223/437] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:26.312694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce48865-335d-48cb-be7e-5e025c4fe56b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:26.401573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 215/438] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:26.407356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257b6d0-b356-4a1c-8870-f30d48a4c157 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:26.427217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce48865-335d-48cb-be7e-5e025c4fe56b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:26.462582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4662-97b7-48f4-a551-89bebd661c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:26.463405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4662-97b7-48f4-a551-89bebd661c24 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.463688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4662-97b7-48f4-a551-89bebd661c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.463965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4662-97b7-48f4-a551-89bebd661c24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.477736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c4662-97b7-48f4-a551-89bebd661c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:26.484229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-6c2c4662-97b7-48f4-a551-89bebd661c24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:11:26.485690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 224/439] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:26.492064 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4662-97b7-48f4-a551-89bebd661c24 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:26.527389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257b6d0-b356-4a1c-8870-f30d48a4c157 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:26.571432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1f67e-6f66-4aa0-8294-73ddd6513074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:26.572222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1f67e-6f66-4aa0-8294-73ddd6513074 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.572499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1f67e-6f66-4aa0-8294-73ddd6513074 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.572767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1f67e-6f66-4aa0-8294-73ddd6513074 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.574563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1f67e-6f66-4aa0-8294-73ddd6513074 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:26.576669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1f67e-6f66-4aa0-8294-73ddd6513074 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:26.582175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 216/440] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:26.583876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1f67e-6f66-4aa0-8294-73ddd6513074 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:26.631014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4662-97b7-48f4-a551-89bebd661c24 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:26.665086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a355263-c60a-4b18-a8e4-5cb275b25d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:26.665758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a355263-c60a-4b18-a8e4-5cb275b25d97 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.666044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a355263-c60a-4b18-a8e4-5cb275b25d97 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.666350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a355263-c60a-4b18-a8e4-5cb275b25d97 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.667094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a355263-c60a-4b18-a8e4-5cb275b25d97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:26.667402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a355263-c60a-4b18-a8e4-5cb275b25d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:26.668771 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a355263-c60a-4b18-a8e4-5cb275b25d97 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:26.676677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 225/441] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:26.677864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c0ca-811a-4580-99b7-237219b2f791 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.678193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c0ca-811a-4580-99b7-237219b2f791 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.678500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c0ca-811a-4580-99b7-237219b2f791 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.680261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 226/442] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:26.682042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7c0ca-811a-4580-99b7-237219b2f791 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:26.692432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1f67e-6f66-4aa0-8294-73ddd6513074 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:26.724196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdba3a-7018-4936-b418-ccddcff2f0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:26.725048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdba3a-7018-4936-b418-ccddcff2f0b6 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.725903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdba3a-7018-4936-b418-ccddcff2f0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.726214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdba3a-7018-4936-b418-ccddcff2f0b6 None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.727383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdba3a-7018-4936-b418-ccddcff2f0b6 None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:26.728808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdba3a-7018-4936-b418-ccddcff2f0b6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:26.730436 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 217/443] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:26.731551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15410-7feb-4e7c-993e-36e7904203fb None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.731838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15410-7feb-4e7c-993e-36e7904203fb None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.732117 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15410-7feb-4e7c-993e-36e7904203fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.747621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bdf15410-7feb-4e7c-993e-36e7904203fb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:26.748790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bdf15410-7feb-4e7c-993e-36e7904203fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:26.776961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7c0ca-811a-4580-99b7-237219b2f791 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:26.810400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0258b-a26d-42f5-8861-725691d54384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:26.811049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0258b-a26d-42f5-8861-725691d54384 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.811263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 218/444] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:26.811688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0258b-a26d-42f5-8861-725691d54384 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.811688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0258b-a26d-42f5-8861-725691d54384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.812087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15410-7feb-4e7c-993e-36e7904203fb None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:26.877956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0258b-a26d-42f5-8861-725691d54384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:26.879346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0258b-a26d-42f5-8861-725691d54384 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:26.908486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15410-7feb-4e7c-993e-36e7904203fb None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:26.944430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f91dc-333f-41e0-a8e8-b100113ca779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:26.945083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f91dc-333f-41e0-a8e8-b100113ca779 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:26.945369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f91dc-333f-41e0-a8e8-b100113ca779 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:26.945649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f91dc-333f-41e0-a8e8-b100113ca779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:26.946512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f91dc-333f-41e0-a8e8-b100113ca779 None admin] RBAC: Adding query filter params (group.id=bd784d726b384649922f40935bb92857, role.id=43e227d04ba64588acce441d98a394f3, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:26.946823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f91dc-333f-41e0-a8e8-b100113ca779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:26.948259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f91dc-333f-41e0-a8e8-b100113ca779 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:26.953736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 219/445] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/role_assignments?group.id=bd784d726b384649922f40935bb92857&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=43e227d04ba64588acce441d98a394f3 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:26.954537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f91dc-333f-41e0-a8e8-b100113ca779 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:26.981024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 227/446] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 10 17:11:26.987772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0258b-a26d-42f5-8861-725691d54384 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:27.057498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f91dc-333f-41e0-a8e8-b100113ca779 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:27.092904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0258b-a26d-42f5-8861-725691d54384 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:27.093951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e19f17-7c40-4a51-a4d1-d3badd833f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:27.094825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e19f17-7c40-4a51-a4d1-d3badd833f98 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:27.095112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e19f17-7c40-4a51-a4d1-d3badd833f98 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:27.095398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e19f17-7c40-4a51-a4d1-d3badd833f98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:27.106825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e19f17-7c40-4a51-a4d1-d3badd833f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:27.113965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-d6e19f17-7c40-4a51-a4d1-d3badd833f98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:11:27.115494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 220/447] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:27.121238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e19f17-7c40-4a51-a4d1-d3badd833f98 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:27.128284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc024c3-c666-4fab-a913-28e300d66871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:27.129076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc024c3-c666-4fab-a913-28e300d66871 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:27.129355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc024c3-c666-4fab-a913-28e300d66871 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:27.129625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc024c3-c666-4fab-a913-28e300d66871 None admin] PATH_INFO: `/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:27.130833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc024c3-c666-4fab-a913-28e300d66871 None admin] RBAC: Authorizing `identity:get_project(project_id=6a8c509ed7ee4a9fa17ee6d4f413c080)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:27.132325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc024c3-c666-4fab-a913-28e300d66871 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:27.134050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 228/448] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:26 2022] GET /identity/v3/projects/6a8c509ed7ee4a9fa17ee6d4f413c080 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:27.139463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc024c3-c666-4fab-a913-28e300d66871 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:27.226749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e19f17-7c40-4a51-a4d1-d3badd833f98 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:27.250913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc024c3-c666-4fab-a913-28e300d66871 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:27.263741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe47a77-7d07-44d0-96e6-21d0969652cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:27.264413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe47a77-7d07-44d0-96e6-21d0969652cc None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:27.264704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe47a77-7d07-44d0-96e6-21d0969652cc None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:27.264981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe47a77-7d07-44d0-96e6-21d0969652cc None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:27.265729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe47a77-7d07-44d0-96e6-21d0969652cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:27.266037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe47a77-7d07-44d0-96e6-21d0969652cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:27.267441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe47a77-7d07-44d0-96e6-21d0969652cc None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:27.276476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 221/449] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:27.283924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe47a77-7d07-44d0-96e6-21d0969652cc None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:27.290856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99f61e-bff1-4eff-a53a-8c69fc3dae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:27.291884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99f61e-bff1-4eff-a53a-8c69fc3dae0d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:27.292264 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99f61e-bff1-4eff-a53a-8c69fc3dae0d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:27.292634 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99f61e-bff1-4eff-a53a-8c69fc3dae0d None admin] PATH_INFO: `/v3/groups/bd784d726b384649922f40935bb92857` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:27.294402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99f61e-bff1-4eff-a53a-8c69fc3dae0d None admin] RBAC: Authorizing `identity:get_group(group_id=bd784d726b384649922f40935bb92857)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:27.295970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99f61e-bff1-4eff-a53a-8c69fc3dae0d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:27.298815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 229/450] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:27 2022] GET /identity/v3/groups/bd784d726b384649922f40935bb92857 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:27.305993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99f61e-bff1-4eff-a53a-8c69fc3dae0d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:27.391296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe47a77-7d07-44d0-96e6-21d0969652cc None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:27.404514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99f61e-bff1-4eff-a53a-8c69fc3dae0d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:27.423135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f4d2d-d869-44f7-a394-613d69fe666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:27.423763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f4d2d-d869-44f7-a394-613d69fe666f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:27.424041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f4d2d-d869-44f7-a394-613d69fe666f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:27.424312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f4d2d-d869-44f7-a394-613d69fe666f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:27.436373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14effc58-9c67-4d64-87e7-868aaae9b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:27.437022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14effc58-9c67-4d64-87e7-868aaae9b3bf None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:27.437305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14effc58-9c67-4d64-87e7-868aaae9b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:27.437582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14effc58-9c67-4d64-87e7-868aaae9b3bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:27.438457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14effc58-9c67-4d64-87e7-868aaae9b3bf None admin] RBAC: Adding query filter params (group.id=bd784d726b384649922f40935bb92857, role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:27.438764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14effc58-9c67-4d64-87e7-868aaae9b3bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:27.440179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14effc58-9c67-4d64-87e7-868aaae9b3bf None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:27.445644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 230/451] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:27 2022] GET /identity/v3/role_assignments?group.id=bd784d726b384649922f40935bb92857&scope.project.id=6a8c509ed7ee4a9fa17ee6d4f413c080&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:27.491013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f4d2d-d869-44f7-a394-613d69fe666f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:27.492507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f4d2d-d869-44f7-a394-613d69fe666f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:27.591906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 222/452] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 10 17:11:27.597686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14effc58-9c67-4d64-87e7-868aaae9b3bf None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:27.695043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14effc58-9c67-4d64-87e7-868aaae9b3bf None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:27.727429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b64b1-de58-4a68-bece-e35ac88ebc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:27.728301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b64b1-de58-4a68-bece-e35ac88ebc90 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:27.728584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b64b1-de58-4a68-bece-e35ac88ebc90 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:27.728862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b64b1-de58-4a68-bece-e35ac88ebc90 None admin] PATH_INFO: `/v3/projects/6b6da1569d25429788d1024be5510eba` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:27.730041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b64b1-de58-4a68-bece-e35ac88ebc90 None admin] RBAC: Authorizing `identity:get_project(project_id=6b6da1569d25429788d1024be5510eba)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:27.731530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b64b1-de58-4a68-bece-e35ac88ebc90 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:27.733232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 231/453] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:11:27 2022] GET /identity/v3/projects/6b6da1569d25429788d1024be5510eba => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:27.738927 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f4d2d-d869-44f7-a394-613d69fe666f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:27.834898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f4d2d-d869-44f7-a394-613d69fe666f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:27.866941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd98df-b2af-4129-b74a-3fd136ebd53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:27.867785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd98df-b2af-4129-b74a-3fd136ebd53c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:27.868068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd98df-b2af-4129-b74a-3fd136ebd53c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:27.868341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd98df-b2af-4129-b74a-3fd136ebd53c None admin] PATH_INFO: `/v3/groups/6e64c9b777bd4799919fc08d1825b7b8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:27.869506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd98df-b2af-4129-b74a-3fd136ebd53c None admin] RBAC: Authorizing `identity:get_group(group_id=6e64c9b777bd4799919fc08d1825b7b8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:27.870965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd98df-b2af-4129-b74a-3fd136ebd53c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:27.872546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 223/454] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Mar 10 17:11:27 2022] GET /identity/v3/groups/6e64c9b777bd4799919fc08d1825b7b8 => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:27.878519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b64b1-de58-4a68-bece-e35ac88ebc90 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:27.969789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b64b1-de58-4a68-bece-e35ac88ebc90 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:28.000641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f071f-8659-4eb2-9e06-629d33e7982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:28.001272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f071f-8659-4eb2-9e06-629d33e7982d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:28.001551 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f071f-8659-4eb2-9e06-629d33e7982d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:28.001826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f071f-8659-4eb2-9e06-629d33e7982d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:28.002659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f071f-8659-4eb2-9e06-629d33e7982d None admin] RBAC: Adding query filter params (group.id=6e64c9b777bd4799919fc08d1825b7b8, role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=6b6da1569d25429788d1024be5510eba) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:28.002969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f071f-8659-4eb2-9e06-629d33e7982d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:28.004369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f071f-8659-4eb2-9e06-629d33e7982d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:28.009730 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 232/455] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Mar 10 17:11:27 2022] GET /identity/v3/role_assignments?group.id=6e64c9b777bd4799919fc08d1825b7b8&scope.project.id=6b6da1569d25429788d1024be5510eba&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 611 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:30.676506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d3656-cab6-4e19-8ed9-f058990d81d6 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:30.676984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d3656-cab6-4e19-8ed9-f058990d81d6 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:30.676984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d3656-cab6-4e19-8ed9-f058990d81d6 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:30.679042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 224/456] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:30.684459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3190f-8f91-4fda-a011-8ead57a913d8 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:30.684890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3190f-8f91-4fda-a011-8ead57a913d8 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:30.685062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3190f-8f91-4fda-a011-8ead57a913d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:30.707899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-44f3190f-8f91-4fda-a011-8ead57a913d8 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:30.709059 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-44f3190f-8f91-4fda-a011-8ead57a913d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:30.792268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 233/457] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:30.829854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d3656-cab6-4e19-8ed9-f058990d81d6 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:30.957559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d3656-cab6-4e19-8ed9-f058990d81d6 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:31.003714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45f2f6-3178-4b08-8035-13c43fccd300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:31.004511 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45f2f6-3178-4b08-8035-13c43fccd300 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.004789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45f2f6-3178-4b08-8035-13c43fccd300 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.005056 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45f2f6-3178-4b08-8035-13c43fccd300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.019824 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff70ebb-f420-463a-a795-ab1c2986e33c None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.020127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff70ebb-f420-463a-a795-ab1c2986e33c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.020391 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff70ebb-f420-463a-a795-ab1c2986e33c None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.022201 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 234/458] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:31.022880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45f2f6-3178-4b08-8035-13c43fccd300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:31.024530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45f2f6-3178-4b08-8035-13c43fccd300 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:31.041657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c946a-3a32-4473-8239-8bcd70ecba01 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.041977 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c946a-3a32-4473-8239-8bcd70ecba01 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.042239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c946a-3a32-4473-8239-8bcd70ecba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.046207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-df45f2f6-3178-4b08-8035-13c43fccd300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:31.048406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 225/459] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:31.054677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45f2f6-3178-4b08-8035-13c43fccd300 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:31.080444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c91c946a-3a32-4473-8239-8bcd70ecba01 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:31.081634 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c91c946a-3a32-4473-8239-8bcd70ecba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:31.182097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 235/460] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:31.183555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fca66-ad52-476f-baa6-01df244b0cb8 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.183842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fca66-ad52-476f-baa6-01df244b0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.184118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fca66-ad52-476f-baa6-01df244b0cb8 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.185871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 236/461] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:31.190971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db57b3-d949-4803-b914-58b956818caa None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.191258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db57b3-d949-4803-b914-58b956818caa None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.191534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db57b3-d949-4803-b914-58b956818caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.213655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45f2f6-3178-4b08-8035-13c43fccd300 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:31.215193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d1db57b3-d949-4803-b914-58b956818caa None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:31.216373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d1db57b3-d949-4803-b914-58b956818caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:31.255137 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f471bd5-5bfa-40ec-90ec-a97e0c15ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:31.256129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471bd5-5bfa-40ec-90ec-a97e0c15ab8c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.256651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471bd5-5bfa-40ec-90ec-a97e0c15ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.257094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471bd5-5bfa-40ec-90ec-a97e0c15ab8c None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.257997 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f471bd5-5bfa-40ec-90ec-a97e0c15ab8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:31.258504 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f471bd5-5bfa-40ec-90ec-a97e0c15ab8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:31.260644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f471bd5-5bfa-40ec-90ec-a97e0c15ab8c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:31.275501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 226/462] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:31.276950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f471bd5-5bfa-40ec-90ec-a97e0c15ab8c None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:31.292357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 237/463] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:31.292357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db57b3-d949-4803-b914-58b956818caa None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:31.409979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f471bd5-5bfa-40ec-90ec-a97e0c15ab8c None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:31.418461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db57b3-d949-4803-b914-58b956818caa None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:31.455794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2926f4-7908-4df7-bad4-944fd68eed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:31.456539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2926f4-7908-4df7-bad4-944fd68eed2c None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.456822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2926f4-7908-4df7-bad4-944fd68eed2c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.457181 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2926f4-7908-4df7-bad4-944fd68eed2c None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.457841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2926f4-7908-4df7-bad4-944fd68eed2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:31.459308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2926f4-7908-4df7-bad4-944fd68eed2c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:31.461166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca54ced-3657-418d-860c-172a57f807a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:31.462226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca54ced-3657-418d-860c-172a57f807a2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.462718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca54ced-3657-418d-860c-172a57f807a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.463179 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca54ced-3657-418d-860c-172a57f807a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.474412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca54ced-3657-418d-860c-172a57f807a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:31.477825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca54ced-3657-418d-860c-172a57f807a2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:31.481660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 238/464] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:11:31 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:11:31.486950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2926f4-7908-4df7-bad4-944fd68eed2c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:31.507500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-cca54ced-3657-418d-860c-172a57f807a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:31.520576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 227/465] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:31.527940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca54ced-3657-418d-860c-172a57f807a2 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:31.638944 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2926f4-7908-4df7-bad4-944fd68eed2c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:31.674156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca54ced-3657-418d-860c-172a57f807a2 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:31.676367 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a350f-87c6-4348-b5eb-98ad1cd7042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:31.677445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a350f-87c6-4348-b5eb-98ad1cd7042b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.677936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a350f-87c6-4348-b5eb-98ad1cd7042b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.678480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a350f-87c6-4348-b5eb-98ad1cd7042b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.690272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a350f-87c6-4348-b5eb-98ad1cd7042b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:31.692558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a350f-87c6-4348-b5eb-98ad1cd7042b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:31.711257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-e09a350f-87c6-4348-b5eb-98ad1cd7042b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:31.711769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c9b1-90eb-424c-ba33-d58521a11945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:31.712437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c9b1-90eb-424c-ba33-d58521a11945 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.712722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c9b1-90eb-424c-ba33-d58521a11945 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.712999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c9b1-90eb-424c-ba33-d58521a11945 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.713722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97c9b1-90eb-424c-ba33-d58521a11945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:31.714027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97c9b1-90eb-424c-ba33-d58521a11945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:31.714525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 239/466] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:31.715432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97c9b1-90eb-424c-ba33-d58521a11945 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:31.716138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d4b52-8cae-4434-9972-bf0796b332fb None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.716622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d4b52-8cae-4434-9972-bf0796b332fb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.717086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d4b52-8cae-4434-9972-bf0796b332fb None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.719226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 240/467] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:31.724728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2329f-81f6-483a-8d8a-1a2477ffce83 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.725876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2329f-81f6-483a-8d8a-1a2477ffce83 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.726384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2329f-81f6-483a-8d8a-1a2477ffce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.728601 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 228/468] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:31.729431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c9b1-90eb-424c-ba33-d58521a11945 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:31.744136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-61e2329f-81f6-483a-8d8a-1a2477ffce83 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:31.745545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-61e2329f-81f6-483a-8d8a-1a2477ffce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:31.823646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 241/469] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:31.824585 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2329f-81f6-483a-8d8a-1a2477ffce83 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:31.844904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c9b1-90eb-424c-ba33-d58521a11945 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:31.880094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948c14-2b66-48a2-aeb4-1fe8db67a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:31.880757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948c14-2b66-48a2-aeb4-1fe8db67a41d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.881037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948c14-2b66-48a2-aeb4-1fe8db67a41d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.881346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948c14-2b66-48a2-aeb4-1fe8db67a41d None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.882072 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948c14-2b66-48a2-aeb4-1fe8db67a41d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:31.882403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948c14-2b66-48a2-aeb4-1fe8db67a41d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:31.883791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948c14-2b66-48a2-aeb4-1fe8db67a41d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:31.901156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 229/470] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:31.902086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948c14-2b66-48a2-aeb4-1fe8db67a41d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:31.941686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2329f-81f6-483a-8d8a-1a2477ffce83 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:31.977566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b1c88-bc8d-47d3-b430-4a8f09264c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:31.978197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1c88-bc8d-47d3-b430-4a8f09264c6f None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:31.978535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1c88-bc8d-47d3-b430-4a8f09264c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:31.978819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1c88-bc8d-47d3-b430-4a8f09264c6f None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:31.979522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b1c88-bc8d-47d3-b430-4a8f09264c6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:31.980965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b1c88-bc8d-47d3-b430-4a8f09264c6f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:32.002616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 242/471] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:11:31 2022] POST /identity/v3/users => generated 248 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:11:32.003475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b1c88-bc8d-47d3-b430-4a8f09264c6f None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:32.013587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948c14-2b66-48a2-aeb4-1fe8db67a41d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:32.112309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bafc5-b46d-4599-b6af-66316d37d958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:32.113130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bafc5-b46d-4599-b6af-66316d37d958 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:32.113260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b1c88-bc8d-47d3-b430-4a8f09264c6f None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:32.113421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bafc5-b46d-4599-b6af-66316d37d958 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:32.113686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bafc5-b46d-4599-b6af-66316d37d958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:32.140396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bafc5-b46d-4599-b6af-66316d37d958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:32.141881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bafc5-b46d-4599-b6af-66316d37d958 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:32.149768 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa801b7-3a13-4549-ba39-65e251f0175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:32.150505 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa801b7-3a13-4549-ba39-65e251f0175d None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:32.150792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa801b7-3a13-4549-ba39-65e251f0175d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:32.151234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa801b7-3a13-4549-ba39-65e251f0175d None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:32.151772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa801b7-3a13-4549-ba39-65e251f0175d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:32.153240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa801b7-3a13-4549-ba39-65e251f0175d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:32.179009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-567bafc5-b46d-4599-b6af-66316d37d958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:32.180503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 230/472] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:32.187890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bafc5-b46d-4599-b6af-66316d37d958 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:32.192779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 243/473] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:11:32 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:11:32.329773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bafc5-b46d-4599-b6af-66316d37d958 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:32.357834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2d9cd-0c51-4463-8152-ea40e715f986 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:32.358231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2d9cd-0c51-4463-8152-ea40e715f986 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:32.358431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2d9cd-0c51-4463-8152-ea40e715f986 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:32.360543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 244/474] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:32.367533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1dcc-1b6e-434f-bf10-3f6a5a8c07c0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:32.367838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef512-d025-45c9-b757-4b9b4a77ac5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:32.367953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1dcc-1b6e-434f-bf10-3f6a5a8c07c0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:32.368107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1dcc-1b6e-434f-bf10-3f6a5a8c07c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:32.368506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef512-d025-45c9-b757-4b9b4a77ac5a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:32.368786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef512-d025-45c9-b757-4b9b4a77ac5a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:32.369059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef512-d025-45c9-b757-4b9b4a77ac5a None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:32.369840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef512-d025-45c9-b757-4b9b4a77ac5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:32.370176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef512-d025-45c9-b757-4b9b4a77ac5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:32.371561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef512-d025-45c9-b757-4b9b4a77ac5a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:32.386570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-69fe1dcc-1b6e-434f-bf10-3f6a5a8c07c0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:32.386944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 231/475] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:32.387845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-69fe1dcc-1b6e-434f-bf10-3f6a5a8c07c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:32.392868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef512-d025-45c9-b757-4b9b4a77ac5a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:32.472970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 245/476] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:32.502224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe1dcc-1b6e-434f-bf10-3f6a5a8c07c0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:32.515416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef512-d025-45c9-b757-4b9b4a77ac5a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:32.554572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f67f66-a1ec-4d90-aff5-4b6e1fb285ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:32.556314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67f66-a1ec-4d90-aff5-4b6e1fb285ac None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:32.557002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67f66-a1ec-4d90-aff5-4b6e1fb285ac None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:32.557594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67f66-a1ec-4d90-aff5-4b6e1fb285ac None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:32.558883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f67f66-a1ec-4d90-aff5-4b6e1fb285ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:32.561272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f67f66-a1ec-4d90-aff5-4b6e1fb285ac None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:32.593158 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 232/477] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:11:32 2022] POST /identity/v3/users => generated 249 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:11:32.636482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe1dcc-1b6e-434f-bf10-3f6a5a8c07c0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:32.672948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:32.673977 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:32.674496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:32.674965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:32.675987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:32.677563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:32.685118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.sql.core [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 10 17:11:32.685118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 10 17:11:32.685118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [parameters: {'id': 'f6665216d4d64ca1b7a8542912eb70db', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 10 17:11:32.685118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79406) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 10 17:11:32.701234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 10 17:11:32.703886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 246/478] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Mar 10 17:11:32 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:32.711562 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f67f66-a1ec-4d90-aff5-4b6e1fb285ac None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:32.825057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f67f66-a1ec-4d90-aff5-4b6e1fb285ac None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:32.861101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31a69a-6f01-4150-bea8-ee0537c1be3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:32.862336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a69a-6f01-4150-bea8-ee0537c1be3a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:32.862840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a69a-6f01-4150-bea8-ee0537c1be3a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:32.863302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a69a-6f01-4150-bea8-ee0537c1be3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:32.874514 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31a69a-6f01-4150-bea8-ee0537c1be3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:32.882696 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-2c31a69a-6f01-4150-bea8-ee0537c1be3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 17:11:32.884591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 233/479] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:11:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:32.891289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:33.016564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbcd21-6ccd-42b8-bff3-2aa6b4f7493a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:33.053876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf5432-7f14-4881-abd8-1cb5ded7532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:33.054583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5432-7f14-4881-abd8-1cb5ded7532f None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:33.054867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5432-7f14-4881-abd8-1cb5ded7532f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:33.055143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5432-7f14-4881-abd8-1cb5ded7532f None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:33.055887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf5432-7f14-4881-abd8-1cb5ded7532f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:33.056186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf5432-7f14-4881-abd8-1cb5ded7532f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:33.057559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf5432-7f14-4881-abd8-1cb5ded7532f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:33.065737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 247/480] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:34.313612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e49d5-bbfc-4e12-8911-363fcfe172be None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:34.314061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e49d5-bbfc-4e12-8911-363fcfe172be None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:34.314184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e49d5-bbfc-4e12-8911-363fcfe172be None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:34.316331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 234/481] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:34.322075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c33013-9864-4a3c-b3d4-1cd019611e7d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:34.322520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c33013-9864-4a3c-b3d4-1cd019611e7d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:34.322695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c33013-9864-4a3c-b3d4-1cd019611e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:34.340177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-17c33013-9864-4a3c-b3d4-1cd019611e7d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:34.341365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-17c33013-9864-4a3c-b3d4-1cd019611e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:34.414241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 248/482] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:34.433812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e49d5-bbfc-4e12-8911-363fcfe172be None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:34.562170 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e49d5-bbfc-4e12-8911-363fcfe172be None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:34.600891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743894-6aa3-48ac-a64b-a99435389858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:34.602090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743894-6aa3-48ac-a64b-a99435389858 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:34.602602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743894-6aa3-48ac-a64b-a99435389858 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:34.603081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743894-6aa3-48ac-a64b-a99435389858 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:34.616205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743894-6aa3-48ac-a64b-a99435389858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:34.623980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-3d743894-6aa3-48ac-a64b-a99435389858 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:34.625917 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 235/483] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:34.634292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c33013-9864-4a3c-b3d4-1cd019611e7d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:34.784692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c33013-9864-4a3c-b3d4-1cd019611e7d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:34.831929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aede94b-7a39-460a-8c85-63f7559fed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:34.832999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede94b-7a39-460a-8c85-63f7559fed2a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:34.833514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede94b-7a39-460a-8c85-63f7559fed2a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:34.834001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede94b-7a39-460a-8c85-63f7559fed2a None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:34.835538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede94b-7a39-460a-8c85-63f7559fed2a None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:34.836090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede94b-7a39-460a-8c85-63f7559fed2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:34.837701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede94b-7a39-460a-8c85-63f7559fed2a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:34.851173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 249/484] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:34.856352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743894-6aa3-48ac-a64b-a99435389858 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:34.997053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743894-6aa3-48ac-a64b-a99435389858 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:34.997584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a02d-ebca-4b24-ade9-7cedeee45efe None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:34.997876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a02d-ebca-4b24-ade9-7cedeee45efe None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:34.998181 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a02d-ebca-4b24-ade9-7cedeee45efe None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.000229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 250/485] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:35.005165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84810ccb-4b41-4582-9b08-79cdcc32136f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.005452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84810ccb-4b41-4582-9b08-79cdcc32136f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.005729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84810ccb-4b41-4582-9b08-79cdcc32136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.023732 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-84810ccb-4b41-4582-9b08-79cdcc32136f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:35.024921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-84810ccb-4b41-4582-9b08-79cdcc32136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:35.054739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e0654-08cf-4b27-96eb-ece97cd8a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.055535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e0654-08cf-4b27-96eb-ece97cd8a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.055818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e0654-08cf-4b27-96eb-ece97cd8a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.056097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e0654-08cf-4b27-96eb-ece97cd8a2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.073181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e0654-08cf-4b27-96eb-ece97cd8a2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:35.074681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e0654-08cf-4b27-96eb-ece97cd8a2a2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:35.097752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-588e0654-08cf-4b27-96eb-ece97cd8a2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:35.099213 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 236/486] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:35.100455 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080b9f5-fbc6-4608-9b61-ee6cb3d4ecad None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.100742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080b9f5-fbc6-4608-9b61-ee6cb3d4ecad None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.101019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080b9f5-fbc6-4608-9b61-ee6cb3d4ecad None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.102933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 237/487] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:35.105299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080b9f5-fbc6-4608-9b61-ee6cb3d4ecad None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.134693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 251/488] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:35.136037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b4599-85c5-46b6-a133-63f5d3592301 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.136331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b4599-85c5-46b6-a133-63f5d3592301 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.136614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b4599-85c5-46b6-a133-63f5d3592301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.155108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-364b4599-85c5-46b6-a133-63f5d3592301 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:35.156351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-364b4599-85c5-46b6-a133-63f5d3592301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:35.238496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080b9f5-fbc6-4608-9b61-ee6cb3d4ecad None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:35.246215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 252/489] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:35.247116 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b4599-85c5-46b6-a133-63f5d3592301 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.276775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a4e3-de32-4a84-881f-3213a08a5469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.277984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a4e3-de32-4a84-881f-3213a08a5469 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.278416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a4e3-de32-4a84-881f-3213a08a5469 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.278693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a4e3-de32-4a84-881f-3213a08a5469 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.279616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74a4e3-de32-4a84-881f-3213a08a5469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:35.280256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74a4e3-de32-4a84-881f-3213a08a5469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:35.281702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74a4e3-de32-4a84-881f-3213a08a5469 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:35.306140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 238/490] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:35.306140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a4e3-de32-4a84-881f-3213a08a5469 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.391146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b4599-85c5-46b6-a133-63f5d3592301 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:35.408013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a4e3-de32-4a84-881f-3213a08a5469 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:35.436370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a63802-e786-440a-8462-70072dd71cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.437951 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a63802-e786-440a-8462-70072dd71cd1 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.438412 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a63802-e786-440a-8462-70072dd71cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.438939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a63802-e786-440a-8462-70072dd71cd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.441732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7210a2-ebd3-4264-a53a-b5ee48b63f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.442474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7210a2-ebd3-4264-a53a-b5ee48b63f4d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.442847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7210a2-ebd3-4264-a53a-b5ee48b63f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.443230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7210a2-ebd3-4264-a53a-b5ee48b63f4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.452011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a63802-e786-440a-8462-70072dd71cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:35.454567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7210a2-ebd3-4264-a53a-b5ee48b63f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:35.460054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-50a63802-e786-440a-8462-70072dd71cd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:35.461787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 253/491] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:35.462782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a63802-e786-440a-8462-70072dd71cd1 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.467477 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-7e7210a2-ebd3-4264-a53a-b5ee48b63f4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:35.469976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 239/492] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:35.471058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7210a2-ebd3-4264-a53a-b5ee48b63f4d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.573138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a63802-e786-440a-8462-70072dd71cd1 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:35.606519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7210a2-ebd3-4264-a53a-b5ee48b63f4d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:35.607551 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a392c-02c6-4551-ac5a-86b04662438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.609238 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a392c-02c6-4551-ac5a-86b04662438c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.610530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a392c-02c6-4551-ac5a-86b04662438c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.610858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a392c-02c6-4551-ac5a-86b04662438c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.624051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a392c-02c6-4551-ac5a-86b04662438c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:35.626234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a392c-02c6-4551-ac5a-86b04662438c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:35.644167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-923a392c-02c6-4551-ac5a-86b04662438c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 17:11:35.644323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a669f-f855-4128-9982-b0150a008845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.645003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a669f-f855-4128-9982-b0150a008845 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.645273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a669f-f855-4128-9982-b0150a008845 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.645551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a669f-f855-4128-9982-b0150a008845 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.646349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a669f-f855-4128-9982-b0150a008845 None admin] RBAC: Adding query filter params (name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:35.646658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a669f-f855-4128-9982-b0150a008845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:35.647132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 254/493] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:35.648176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a669f-f855-4128-9982-b0150a008845 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:35.648423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a392c-02c6-4551-ac5a-86b04662438c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.662898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 240/494] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:35.662898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a669f-f855-4128-9982-b0150a008845 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.759781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a392c-02c6-4551-ac5a-86b04662438c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:35.763589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a669f-f855-4128-9982-b0150a008845 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:35.793517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c45f4b-f448-4574-9ccc-1cf47da4ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.794226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45f4b-f448-4574-9ccc-1cf47da4ea27 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.794518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45f4b-f448-4574-9ccc-1cf47da4ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.794800 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45f4b-f448-4574-9ccc-1cf47da4ea27 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.795603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c45f4b-f448-4574-9ccc-1cf47da4ea27 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:35.795917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c45f4b-f448-4574-9ccc-1cf47da4ea27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:35.797705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c45f4b-f448-4574-9ccc-1cf47da4ea27 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:35.799109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c33fd2-e289-4976-9d4f-7f2b3c21832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.799997 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33fd2-e289-4976-9d4f-7f2b3c21832b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.800471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33fd2-e289-4976-9d4f-7f2b3c21832b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.800956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33fd2-e289-4976-9d4f-7f2b3c21832b None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.801957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c33fd2-e289-4976-9d4f-7f2b3c21832b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:35.802465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c33fd2-e289-4976-9d4f-7f2b3c21832b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:35.804767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c33fd2-e289-4976-9d4f-7f2b3c21832b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:35.811700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 255/495] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:35.811700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c45f4b-f448-4574-9ccc-1cf47da4ea27 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.847288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 241/496] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:35.848533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c33fd2-e289-4976-9d4f-7f2b3c21832b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.908530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c45f4b-f448-4574-9ccc-1cf47da4ea27 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:35.944283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c33fd2-e289-4976-9d4f-7f2b3c21832b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:35.946029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0ef16-0c1e-48f4-910a-1f9f8001fa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.947002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0ef16-0c1e-48f4-910a-1f9f8001fa90 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.947423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0ef16-0c1e-48f4-910a-1f9f8001fa90 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.947834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0ef16-0c1e-48f4-910a-1f9f8001fa90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.958044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0ef16-0c1e-48f4-910a-1f9f8001fa90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:35.959575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0ef16-0c1e-48f4-910a-1f9f8001fa90 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:35.976131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-7fd0ef16-0c1e-48f4-910a-1f9f8001fa90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:35.976642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9284b5e-9b32-4d45-a204-442fe378ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:35.981867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 256/497] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:35.982016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9284b5e-9b32-4d45-a204-442fe378ee37 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.982016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9284b5e-9b32-4d45-a204-442fe378ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.982016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9284b5e-9b32-4d45-a204-442fe378ee37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.982524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099f72-2d89-4fff-b519-ce9280b5a97b None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:35.982524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099f72-2d89-4fff-b519-ce9280b5a97b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:35.982524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099f72-2d89-4fff-b519-ce9280b5a97b None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:35.982524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 257/498] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:35.982524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10099f72-2d89-4fff-b519-ce9280b5a97b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:35.995928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9284b5e-9b32-4d45-a204-442fe378ee37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:35.997404 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9284b5e-9b32-4d45-a204-442fe378ee37 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.014357 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-c9284b5e-9b32-4d45-a204-442fe378ee37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:36.015550 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 242/499] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:36.016326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9284b5e-9b32-4d45-a204-442fe378ee37 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.082217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10099f72-2d89-4fff-b519-ce9280b5a97b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.108876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9284b5e-9b32-4d45-a204-442fe378ee37 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.113583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db0c35-568f-4525-b5fe-ce5081b0c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.114276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0c35-568f-4525-b5fe-ce5081b0c777 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.114545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0c35-568f-4525-b5fe-ce5081b0c777 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.114818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0c35-568f-4525-b5fe-ce5081b0c777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.140133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0b5d-e27f-4ffc-a5fc-ce20deaa0344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.140777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0b5d-e27f-4ffc-a5fc-ce20deaa0344 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.141055 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0b5d-e27f-4ffc-a5fc-ce20deaa0344 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.141329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0b5d-e27f-4ffc-a5fc-ce20deaa0344 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.142038 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0b5d-e27f-4ffc-a5fc-ce20deaa0344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:36.142368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0b5d-e27f-4ffc-a5fc-ce20deaa0344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:36.143740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0b5d-e27f-4ffc-a5fc-ce20deaa0344 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.155235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 243/500] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:36.156389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bad76-73ba-4542-99c4-cfb0b6b6d7a4 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.156677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bad76-73ba-4542-99c4-cfb0b6b6d7a4 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.156964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bad76-73ba-4542-99c4-cfb0b6b6d7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.173080 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a82bad76-73ba-4542-99c4-cfb0b6b6d7a4 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:36.174216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a82bad76-73ba-4542-99c4-cfb0b6b6d7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:36.178735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db0c35-568f-4525-b5fe-ce5081b0c777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:36.180186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db0c35-568f-4525-b5fe-ce5081b0c777 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.236419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 244/501] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:36.237042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bad76-73ba-4542-99c4-cfb0b6b6d7a4 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.285752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 258/502] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:36.287216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078b45-7df7-49e3-ad1d-1763f02cc826 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.288074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078b45-7df7-49e3-ad1d-1763f02cc826 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.288353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078b45-7df7-49e3-ad1d-1763f02cc826 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.290193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 259/503] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:36.290887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078b45-7df7-49e3-ad1d-1763f02cc826 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.337626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bad76-73ba-4542-99c4-cfb0b6b6d7a4 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.368997 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861cfd0-3b5a-40e6-be6b-2bb4974ed90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.369643 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861cfd0-3b5a-40e6-be6b-2bb4974ed90e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.369932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861cfd0-3b5a-40e6-be6b-2bb4974ed90e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.370238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861cfd0-3b5a-40e6-be6b-2bb4974ed90e None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.370954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861cfd0-3b5a-40e6-be6b-2bb4974ed90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:36.371256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861cfd0-3b5a-40e6-be6b-2bb4974ed90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:36.372633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861cfd0-3b5a-40e6-be6b-2bb4974ed90e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.383216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 245/504] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:36.383984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861cfd0-3b5a-40e6-be6b-2bb4974ed90e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.386358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078b45-7df7-49e3-ad1d-1763f02cc826 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.419144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a0a4b-fac5-4d98-af9e-3e0619ae7f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.419933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a0a4b-fac5-4d98-af9e-3e0619ae7f98 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.420218 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a0a4b-fac5-4d98-af9e-3e0619ae7f98 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.420497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a0a4b-fac5-4d98-af9e-3e0619ae7f98 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.427479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a0a4b-fac5-4d98-af9e-3e0619ae7f98 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:36.428885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a0a4b-fac5-4d98-af9e-3e0619ae7f98 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.442197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-cc2a0a4b-fac5-4d98-af9e-3e0619ae7f98 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 10 17:11:36.443332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 260/505] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:36.444112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a0a4b-fac5-4d98-af9e-3e0619ae7f98 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.478903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861cfd0-3b5a-40e6-be6b-2bb4974ed90e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.510455 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc24f-70bc-4e68-95ad-8a9268b31a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.511273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc24f-70bc-4e68-95ad-8a9268b31a4e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.511558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc24f-70bc-4e68-95ad-8a9268b31a4e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.511834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc24f-70bc-4e68-95ad-8a9268b31a4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.521402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffc24f-70bc-4e68-95ad-8a9268b31a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:36.528987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-42ffc24f-70bc-4e68-95ad-8a9268b31a4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:36.530351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 246/506] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:36.531449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76bbe3-ba7d-4b87-9b12-6fcb6ecdf26a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.531750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76bbe3-ba7d-4b87-9b12-6fcb6ecdf26a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.532027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76bbe3-ba7d-4b87-9b12-6fcb6ecdf26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.536711 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a0a4b-fac5-4d98-af9e-3e0619ae7f98 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.548940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9f76bbe3-ba7d-4b87-9b12-6fcb6ecdf26a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:36.550150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9f76bbe3-ba7d-4b87-9b12-6fcb6ecdf26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:36.567476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec22ec9-e217-4d5d-8fd1-2e0aa1ced3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.568255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec22ec9-e217-4d5d-8fd1-2e0aa1ced3f0 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.568536 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec22ec9-e217-4d5d-8fd1-2e0aa1ced3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.569343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec22ec9-e217-4d5d-8fd1-2e0aa1ced3f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.579194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec22ec9-e217-4d5d-8fd1-2e0aa1ced3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:36.580619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec22ec9-e217-4d5d-8fd1-2e0aa1ced3f0 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.596551 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-1ec22ec9-e217-4d5d-8fd1-2e0aa1ced3f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:36.597691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 261/507] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:36.598465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec22ec9-e217-4d5d-8fd1-2e0aa1ced3f0 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.612928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 247/508] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:36.613750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76bbe3-ba7d-4b87-9b12-6fcb6ecdf26a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.704648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec22ec9-e217-4d5d-8fd1-2e0aa1ced3f0 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.710976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76bbe3-ba7d-4b87-9b12-6fcb6ecdf26a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.735656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7badd6-11c8-4645-a7c0-ee176a237e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.736446 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7badd6-11c8-4645-a7c0-ee176a237e26 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.736725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7badd6-11c8-4645-a7c0-ee176a237e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.736993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7badd6-11c8-4645-a7c0-ee176a237e26 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.741918 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d665b-b9a8-467c-beff-22b399568ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.742605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d665b-b9a8-467c-beff-22b399568ddd None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.742891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d665b-b9a8-467c-beff-22b399568ddd None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.743198 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d665b-b9a8-467c-beff-22b399568ddd None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.744025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d665b-b9a8-467c-beff-22b399568ddd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:36.744126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7badd6-11c8-4645-a7c0-ee176a237e26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:36.744329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d665b-b9a8-467c-beff-22b399568ddd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:36.745475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7badd6-11c8-4645-a7c0-ee176a237e26 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.745736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d665b-b9a8-467c-beff-22b399568ddd None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.759160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-4b7badd6-11c8-4645-a7c0-ee176a237e26 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 10 17:11:36.760290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 262/509] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:36.761037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7badd6-11c8-4645-a7c0-ee176a237e26 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.766625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 248/510] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:36.766625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d665b-b9a8-467c-beff-22b399568ddd None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.852987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7badd6-11c8-4645-a7c0-ee176a237e26 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.857830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d665b-b9a8-467c-beff-22b399568ddd None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:36.885175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b82319-4d82-43b4-9cd3-93a03ea248ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.885826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82319-4d82-43b4-9cd3-93a03ea248ed None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.886122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82319-4d82-43b4-9cd3-93a03ea248ed None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.886411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82319-4d82-43b4-9cd3-93a03ea248ed None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.887134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b82319-4d82-43b4-9cd3-93a03ea248ed None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:36.887436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b82319-4d82-43b4-9cd3-93a03ea248ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:36.888787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b82319-4d82-43b4-9cd3-93a03ea248ed None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.890132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec60eb-4549-42b0-8999-1dd0879be4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:36.890797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec60eb-4549-42b0-8999-1dd0879be4aa None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:36.891099 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec60eb-4549-42b0-8999-1dd0879be4aa None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:36.891374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec60eb-4549-42b0-8999-1dd0879be4aa None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:36.892082 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec60eb-4549-42b0-8999-1dd0879be4aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:36.892385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec60eb-4549-42b0-8999-1dd0879be4aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:36.893723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec60eb-4549-42b0-8999-1dd0879be4aa None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:36.896288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 263/511] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:36.897096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b82319-4d82-43b4-9cd3-93a03ea248ed None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:36.908742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 249/512] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:36.908742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec60eb-4549-42b0-8999-1dd0879be4aa None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.003177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b82319-4d82-43b4-9cd3-93a03ea248ed None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.005862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec60eb-4549-42b0-8999-1dd0879be4aa None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.034718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71a6bc-996c-40e2-a6e0-ddaef7b9df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.035535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71a6bc-996c-40e2-a6e0-ddaef7b9df1c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.035822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71a6bc-996c-40e2-a6e0-ddaef7b9df1c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.036096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71a6bc-996c-40e2-a6e0-ddaef7b9df1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.037033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398b6d2-169a-453f-bf02-3b6d07ac3c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.037718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398b6d2-169a-453f-bf02-3b6d07ac3c71 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.038000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398b6d2-169a-453f-bf02-3b6d07ac3c71 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.038310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398b6d2-169a-453f-bf02-3b6d07ac3c71 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.039131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398b6d2-169a-453f-bf02-3b6d07ac3c71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:37.039437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398b6d2-169a-453f-bf02-3b6d07ac3c71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.040880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398b6d2-169a-453f-bf02-3b6d07ac3c71 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.046042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71a6bc-996c-40e2-a6e0-ddaef7b9df1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.047763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71a6bc-996c-40e2-a6e0-ddaef7b9df1c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.058385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 250/513] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:37.059169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398b6d2-169a-453f-bf02-3b6d07ac3c71 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.063962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-fe71a6bc-996c-40e2-a6e0-ddaef7b9df1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:37.065116 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 264/514] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:37.065871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71a6bc-996c-40e2-a6e0-ddaef7b9df1c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.149818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398b6d2-169a-453f-bf02-3b6d07ac3c71 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.158269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71a6bc-996c-40e2-a6e0-ddaef7b9df1c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.181084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f1f8-b1ed-4328-b2cc-e85766d0c618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.181715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f1f8-b1ed-4328-b2cc-e85766d0c618 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.181993 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f1f8-b1ed-4328-b2cc-e85766d0c618 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.182294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f1f8-b1ed-4328-b2cc-e85766d0c618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.189700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290013-2ac4-4b2c-8ff1-8e87957d528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.190499 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290013-2ac4-4b2c-8ff1-8e87957d528a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.190786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290013-2ac4-4b2c-8ff1-8e87957d528a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.191063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290013-2ac4-4b2c-8ff1-8e87957d528a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.201033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290013-2ac4-4b2c-8ff1-8e87957d528a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.202495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290013-2ac4-4b2c-8ff1-8e87957d528a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.218525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-5c290013-2ac4-4b2c-8ff1-8e87957d528a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:37.219665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 265/515] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:37.220412 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290013-2ac4-4b2c-8ff1-8e87957d528a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.244078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154f1f8-b1ed-4328-b2cc-e85766d0c618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.245639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154f1f8-b1ed-4328-b2cc-e85766d0c618 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.316467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290013-2ac4-4b2c-8ff1-8e87957d528a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.338343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 251/516] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:37.338343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f1f8-b1ed-4328-b2cc-e85766d0c618 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.349479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d2a28-4441-4094-97db-32f97319bafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.350352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d2a28-4441-4094-97db-32f97319bafc None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.350622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d2a28-4441-4094-97db-32f97319bafc None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.350898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d2a28-4441-4094-97db-32f97319bafc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.357294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d2a28-4441-4094-97db-32f97319bafc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.358773 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d2a28-4441-4094-97db-32f97319bafc None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.371972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-3a5d2a28-4441-4094-97db-32f97319bafc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:37.373109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 266/517] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:37.373860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d2a28-4441-4094-97db-32f97319bafc None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.429858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f1f8-b1ed-4328-b2cc-e85766d0c618 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.461638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e1359-a444-41ac-97e9-e34814be64e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.462299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e1359-a444-41ac-97e9-e34814be64e2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.462581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e1359-a444-41ac-97e9-e34814be64e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.462853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e1359-a444-41ac-97e9-e34814be64e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.466096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d2a28-4441-4094-97db-32f97319bafc None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.496854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fa2c9-866c-486d-9933-540e41998611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.497495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fa2c9-866c-486d-9933-540e41998611 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.497775 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fa2c9-866c-486d-9933-540e41998611 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.498047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fa2c9-866c-486d-9933-540e41998611 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.498781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fa2c9-866c-486d-9933-540e41998611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:37.499085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fa2c9-866c-486d-9933-540e41998611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.500423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fa2c9-866c-486d-9933-540e41998611 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.511907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 267/518] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:37.512889 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fa2c9-866c-486d-9933-540e41998611 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.524621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e1359-a444-41ac-97e9-e34814be64e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.526060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e1359-a444-41ac-97e9-e34814be64e2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.607638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fa2c9-866c-486d-9933-540e41998611 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.615378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 252/519] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:37.616699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e1359-a444-41ac-97e9-e34814be64e2 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.639432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37f9a6-a2a5-4527-a63c-c5ae85a4029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.640088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f9a6-a2a5-4527-a63c-c5ae85a4029e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.640372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f9a6-a2a5-4527-a63c-c5ae85a4029e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.640644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f9a6-a2a5-4527-a63c-c5ae85a4029e None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.641352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37f9a6-a2a5-4527-a63c-c5ae85a4029e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:37.641654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37f9a6-a2a5-4527-a63c-c5ae85a4029e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.643041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37f9a6-a2a5-4527-a63c-c5ae85a4029e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.654134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 268/520] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:37.654835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37f9a6-a2a5-4527-a63c-c5ae85a4029e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.707782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e1359-a444-41ac-97e9-e34814be64e2 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.739816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3f0b-5ab3-4f74-a2da-0a1717b590e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.741130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3f0b-5ab3-4f74-a2da-0a1717b590e3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.741408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3f0b-5ab3-4f74-a2da-0a1717b590e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.741679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3f0b-5ab3-4f74-a2da-0a1717b590e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.751226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf3f0b-5ab3-4f74-a2da-0a1717b590e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.752653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf3f0b-5ab3-4f74-a2da-0a1717b590e3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.753092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37f9a6-a2a5-4527-a63c-c5ae85a4029e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.769498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-13cf3f0b-5ab3-4f74-a2da-0a1717b590e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:37.770704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 253/521] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:37.771458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3f0b-5ab3-4f74-a2da-0a1717b590e3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.788497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e0203-9588-4ed6-8b28-a8bd8039ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.789163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e0203-9588-4ed6-8b28-a8bd8039ba72 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.789447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e0203-9588-4ed6-8b28-a8bd8039ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.789721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e0203-9588-4ed6-8b28-a8bd8039ba72 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.790522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e0203-9588-4ed6-8b28-a8bd8039ba72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:37.790835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e0203-9588-4ed6-8b28-a8bd8039ba72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.792253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e0203-9588-4ed6-8b28-a8bd8039ba72 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.811093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 269/522] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:37.811885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e0203-9588-4ed6-8b28-a8bd8039ba72 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.864140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3f0b-5ab3-4f74-a2da-0a1717b590e3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.895305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614b61f-63a0-4e9e-833a-4ae8b9d9c97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.895962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614b61f-63a0-4e9e-833a-4ae8b9d9c97b None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.896246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614b61f-63a0-4e9e-833a-4ae8b9d9c97b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.896519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614b61f-63a0-4e9e-833a-4ae8b9d9c97b None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.897746 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614b61f-63a0-4e9e-833a-4ae8b9d9c97b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.899199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614b61f-63a0-4e9e-833a-4ae8b9d9c97b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.903556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e0203-9588-4ed6-8b28-a8bd8039ba72 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:37.918012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 254/523] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:11:37 2022] POST /identity/v3/users => generated 247 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:11:37.918913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614b61f-63a0-4e9e-833a-4ae8b9d9c97b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:37.950655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2745d-6b36-4454-a063-c615f2aa21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:37.951474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2745d-6b36-4454-a063-c615f2aa21c2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:37.951823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2745d-6b36-4454-a063-c615f2aa21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:37.952100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2745d-6b36-4454-a063-c615f2aa21c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:37.962981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2745d-6b36-4454-a063-c615f2aa21c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:37.964444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2745d-6b36-4454-a063-c615f2aa21c2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:37.982633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-97f2745d-6b36-4454-a063-c615f2aa21c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:37.984213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 270/524] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:37.984718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2745d-6b36-4454-a063-c615f2aa21c2 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.024803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614b61f-63a0-4e9e-833a-4ae8b9d9c97b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.059708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca323b-998c-4f12-bc5c-c36d8e5680d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.060516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca323b-998c-4f12-bc5c-c36d8e5680d2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.060803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca323b-998c-4f12-bc5c-c36d8e5680d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.061081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca323b-998c-4f12-bc5c-c36d8e5680d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.069124 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca323b-998c-4f12-bc5c-c36d8e5680d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.070633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca323b-998c-4f12-bc5c-c36d8e5680d2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.084763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-1eca323b-998c-4f12-bc5c-c36d8e5680d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 10 17:11:38.090530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 255/525] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:38.090530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca323b-998c-4f12-bc5c-c36d8e5680d2 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.090825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2745d-6b36-4454-a063-c615f2aa21c2 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.129573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb67e4a-770e-4b27-8474-3d181f04cc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.130557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb67e4a-770e-4b27-8474-3d181f04cc8c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.131003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb67e4a-770e-4b27-8474-3d181f04cc8c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.131468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb67e4a-770e-4b27-8474-3d181f04cc8c None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.132373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb67e4a-770e-4b27-8474-3d181f04cc8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:38.132859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb67e4a-770e-4b27-8474-3d181f04cc8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.134489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb67e4a-770e-4b27-8474-3d181f04cc8c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.146881 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 271/526] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:38.147942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb67e4a-770e-4b27-8474-3d181f04cc8c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.191031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca323b-998c-4f12-bc5c-c36d8e5680d2 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.223329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1421-b197-4fcc-865a-4cc35e3f4842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.223983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1421-b197-4fcc-865a-4cc35e3f4842 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.224267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1421-b197-4fcc-865a-4cc35e3f4842 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.224551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1421-b197-4fcc-865a-4cc35e3f4842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.225919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1421-b197-4fcc-865a-4cc35e3f4842 None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=89a64b4a57114f77a231a31e16b3923e) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:38.226263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1421-b197-4fcc-865a-4cc35e3f4842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.227704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1421-b197-4fcc-865a-4cc35e3f4842 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.233231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 256/527] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/role_assignments?user.id=89a64b4a57114f77a231a31e16b3923e&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:38.239061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1421-b197-4fcc-865a-4cc35e3f4842 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.255112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb67e4a-770e-4b27-8474-3d181f04cc8c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.294067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f35862-e40a-45d9-8a20-87a862c3de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.294804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35862-e40a-45d9-8a20-87a862c3de01 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.295097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35862-e40a-45d9-8a20-87a862c3de01 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.295375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35862-e40a-45d9-8a20-87a862c3de01 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.296136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f35862-e40a-45d9-8a20-87a862c3de01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:38.296448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f35862-e40a-45d9-8a20-87a862c3de01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.298272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f35862-e40a-45d9-8a20-87a862c3de01 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.316694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 272/528] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:38.317817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f35862-e40a-45d9-8a20-87a862c3de01 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.361701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1421-b197-4fcc-865a-4cc35e3f4842 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.398050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf1ec6-ea60-4570-a0e9-bddf18736eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.399114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1ec6-ea60-4570-a0e9-bddf18736eca None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.399619 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1ec6-ea60-4570-a0e9-bddf18736eca None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.400087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1ec6-ea60-4570-a0e9-bddf18736eca None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.401122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf1ec6-ea60-4570-a0e9-bddf18736eca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:38.401627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf1ec6-ea60-4570-a0e9-bddf18736eca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.403336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf1ec6-ea60-4570-a0e9-bddf18736eca None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.422852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 257/529] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:38.424065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf1ec6-ea60-4570-a0e9-bddf18736eca None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.426323 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f35862-e40a-45d9-8a20-87a862c3de01 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.461474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25017ac1-154f-4485-8e75-c1302a5ddb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.462359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25017ac1-154f-4485-8e75-c1302a5ddb90 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.462643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25017ac1-154f-4485-8e75-c1302a5ddb90 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.462918 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25017ac1-154f-4485-8e75-c1302a5ddb90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.470000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25017ac1-154f-4485-8e75-c1302a5ddb90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.471498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25017ac1-154f-4485-8e75-c1302a5ddb90 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.485752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-25017ac1-154f-4485-8e75-c1302a5ddb90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:38.491616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 273/530] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:38.491616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25017ac1-154f-4485-8e75-c1302a5ddb90 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.528912 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf1ec6-ea60-4570-a0e9-bddf18736eca None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.563596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edab3c-799b-41fd-b859-78f75bdfa440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.564719 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edab3c-799b-41fd-b859-78f75bdfa440 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.565216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edab3c-799b-41fd-b859-78f75bdfa440 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.565690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edab3c-799b-41fd-b859-78f75bdfa440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.572651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edab3c-799b-41fd-b859-78f75bdfa440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.574359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edab3c-799b-41fd-b859-78f75bdfa440 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.587944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-46edab3c-799b-41fd-b859-78f75bdfa440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:38.588923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25017ac1-154f-4485-8e75-c1302a5ddb90 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.589934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 258/531] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:38.590915 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edab3c-799b-41fd-b859-78f75bdfa440 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.623927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9dac8-2edd-48c2-a157-74c0eb8320d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.624580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9dac8-2edd-48c2-a157-74c0eb8320d8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.624915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9dac8-2edd-48c2-a157-74c0eb8320d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.625189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9dac8-2edd-48c2-a157-74c0eb8320d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.689674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edab3c-799b-41fd-b859-78f75bdfa440 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.693230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9dac8-2edd-48c2-a157-74c0eb8320d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.694762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9dac8-2edd-48c2-a157-74c0eb8320d8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.723525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f074-ba3b-4da8-9029-d7e9473f5347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.724516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f074-ba3b-4da8-9029-d7e9473f5347 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.725600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f074-ba3b-4da8-9029-d7e9473f5347 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.726090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f074-ba3b-4da8-9029-d7e9473f5347 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.727055 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426f074-ba3b-4da8-9029-d7e9473f5347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:38.727386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426f074-ba3b-4da8-9029-d7e9473f5347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.728854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426f074-ba3b-4da8-9029-d7e9473f5347 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.752287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 259/532] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:38.752287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f074-ba3b-4da8-9029-d7e9473f5347 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.828893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 274/533] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:38.828893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9dac8-2edd-48c2-a157-74c0eb8320d8 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.858448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f074-ba3b-4da8-9029-d7e9473f5347 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.893354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347e00a-5a23-4221-81b9-6b12fa598ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.894369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e00a-5a23-4221-81b9-6b12fa598ef1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.894845 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e00a-5a23-4221-81b9-6b12fa598ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.895329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e00a-5a23-4221-81b9-6b12fa598ef1 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.896310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347e00a-5a23-4221-81b9-6b12fa598ef1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:38.897388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347e00a-5a23-4221-81b9-6b12fa598ef1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.899018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347e00a-5a23-4221-81b9-6b12fa598ef1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.914451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 260/534] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:38.915748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347e00a-5a23-4221-81b9-6b12fa598ef1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:38.945995 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9dac8-2edd-48c2-a157-74c0eb8320d8 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:38.979323 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac59a85-f268-4b27-a709-990a4b1d61e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:38.979973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac59a85-f268-4b27-a709-990a4b1d61e1 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:38.980298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac59a85-f268-4b27-a709-990a4b1d61e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:38.980572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac59a85-f268-4b27-a709-990a4b1d61e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:38.981427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac59a85-f268-4b27-a709-990a4b1d61e1 None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=9f582002cd7141428072dacd218dbe86) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:38.981685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac59a85-f268-4b27-a709-990a4b1d61e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:38.983119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac59a85-f268-4b27-a709-990a4b1d61e1 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:38.994588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 275/535] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/role_assignments?user.id=9f582002cd7141428072dacd218dbe86&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:38.995576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac59a85-f268-4b27-a709-990a4b1d61e1 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:39.041650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347e00a-5a23-4221-81b9-6b12fa598ef1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:39.123846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d7b6a-a62d-456b-8854-2e60c95c21ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:39.124702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d7b6a-a62d-456b-8854-2e60c95c21ea None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:39.124991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d7b6a-a62d-456b-8854-2e60c95c21ea None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:39.125274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d7b6a-a62d-456b-8854-2e60c95c21ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:39.151731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d7b6a-a62d-456b-8854-2e60c95c21ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:39.153239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d7b6a-a62d-456b-8854-2e60c95c21ea None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:39.168291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac59a85-f268-4b27-a709-990a4b1d61e1 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:39.183605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-895d7b6a-a62d-456b-8854-2e60c95c21ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:39.194700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 261/536] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:39.199832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d7b6a-a62d-456b-8854-2e60c95c21ea None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:39.210627 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7217c-9315-4636-975a-186909e75fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:39.216724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7217c-9315-4636-975a-186909e75fb5 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:39.217281 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7217c-9315-4636-975a-186909e75fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:39.217762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7217c-9315-4636-975a-186909e75fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:39.218834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7217c-9315-4636-975a-186909e75fb5 None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=ad9a11df2d3d4dc292a5115de69bb288) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:39.219354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7217c-9315-4636-975a-186909e75fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:39.220997 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7217c-9315-4636-975a-186909e75fb5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:39.230922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 276/537] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:38 2022] GET /identity/v3/role_assignments?user.id=ad9a11df2d3d4dc292a5115de69bb288&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:39.329439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d7b6a-a62d-456b-8854-2e60c95c21ea None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:39.366003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7343af-bf00-4896-86ec-49414e06ceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:39.366700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7343af-bf00-4896-86ec-49414e06ceda None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:39.366978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7343af-bf00-4896-86ec-49414e06ceda None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:39.367245 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7343af-bf00-4896-86ec-49414e06ceda None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:39.367964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7343af-bf00-4896-86ec-49414e06ceda None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:39.368319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7343af-bf00-4896-86ec-49414e06ceda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:39.369729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7343af-bf00-4896-86ec-49414e06ceda None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:39.382019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 262/538] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:39.387547 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7217c-9315-4636-975a-186909e75fb5 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:39.493784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7217c-9315-4636-975a-186909e75fb5 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:39.531247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccba43c-06ce-46b4-8d72-af5aa86d4326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:39.532203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccba43c-06ce-46b4-8d72-af5aa86d4326 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:39.532487 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccba43c-06ce-46b4-8d72-af5aa86d4326 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:39.532760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccba43c-06ce-46b4-8d72-af5aa86d4326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:39.540478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccba43c-06ce-46b4-8d72-af5aa86d4326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:39.541934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccba43c-06ce-46b4-8d72-af5aa86d4326 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:39.556118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-3ccba43c-06ce-46b4-8d72-af5aa86d4326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:39.557729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 277/539] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:39.563252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7343af-bf00-4896-86ec-49414e06ceda None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:39.662476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7343af-bf00-4896-86ec-49414e06ceda None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:39.695930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbda1d-0062-4726-8ba8-9213583769e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:39.696586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbda1d-0062-4726-8ba8-9213583769e1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:39.696862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbda1d-0062-4726-8ba8-9213583769e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:39.697135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbda1d-0062-4726-8ba8-9213583769e1 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:39.697909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbda1d-0062-4726-8ba8-9213583769e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:39.698246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbda1d-0062-4726-8ba8-9213583769e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:39.699680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbda1d-0062-4726-8ba8-9213583769e1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:39.711637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 263/540] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:39.717397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccba43c-06ce-46b4-8d72-af5aa86d4326 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:39.817641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccba43c-06ce-46b4-8d72-af5aa86d4326 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:39.855785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ea7cf-7ed4-486f-b700-bd4bd21dcc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:39.856456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ea7cf-7ed4-486f-b700-bd4bd21dcc44 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:39.856737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ea7cf-7ed4-486f-b700-bd4bd21dcc44 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:39.857010 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ea7cf-7ed4-486f-b700-bd4bd21dcc44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:39.857838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ea7cf-7ed4-486f-b700-bd4bd21dcc44 None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=701c0e43cc30442582456f4f7153333a) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:39.858161 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ea7cf-7ed4-486f-b700-bd4bd21dcc44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:39.859604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ea7cf-7ed4-486f-b700-bd4bd21dcc44 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:39.865936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 278/541] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:39 2022] GET /identity/v3/role_assignments?user.id=701c0e43cc30442582456f4f7153333a&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:40.504401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13011b5e-da2e-47f3-a91e-43dc55689493 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:40.504926 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13011b5e-da2e-47f3-a91e-43dc55689493 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:40.505347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13011b5e-da2e-47f3-a91e-43dc55689493 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:40.507718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 264/542] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:40.513525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d9ee0-9f66-4ffb-9f8c-08ba78958d32 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:40.514349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d9ee0-9f66-4ffb-9f8c-08ba78958d32 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:40.514774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d9ee0-9f66-4ffb-9f8c-08ba78958d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:40.535850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-3e1d9ee0-9f66-4ffb-9f8c-08ba78958d32 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:40.538117 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3e1d9ee0-9f66-4ffb-9f8c-08ba78958d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:40.622127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 279/543] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:40.657599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13011b5e-da2e-47f3-a91e-43dc55689493 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:40.769151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13011b5e-da2e-47f3-a91e-43dc55689493 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:40.806768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b120159-6cdf-4351-86a6-85eca09dfcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:40.807642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b120159-6cdf-4351-86a6-85eca09dfcdd None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:40.807931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b120159-6cdf-4351-86a6-85eca09dfcdd None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:40.808206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b120159-6cdf-4351-86a6-85eca09dfcdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:40.819204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b120159-6cdf-4351-86a6-85eca09dfcdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:40.826266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-5b120159-6cdf-4351-86a6-85eca09dfcdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:40.827851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 265/544] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:40.833638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d9ee0-9f66-4ffb-9f8c-08ba78958d32 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:40.948409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d9ee0-9f66-4ffb-9f8c-08ba78958d32 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:40.988150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f8fe-dc24-4af9-87ef-bc607ffa3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:40.989186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f8fe-dc24-4af9-87ef-bc607ffa3d4b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:40.989694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f8fe-dc24-4af9-87ef-bc607ffa3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:40.990206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f8fe-dc24-4af9-87ef-bc607ffa3d4b None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:40.991189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f8fe-dc24-4af9-87ef-bc607ffa3d4b None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:40.991695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f8fe-dc24-4af9-87ef-bc607ffa3d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:40.993279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f8fe-dc24-4af9-87ef-bc607ffa3d4b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:41.005404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 280/545] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:41.011124 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b120159-6cdf-4351-86a6-85eca09dfcdd None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:41.011937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778274e-f0b3-4620-a39f-d04ea8c6d1fd None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:41.012229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778274e-f0b3-4620-a39f-d04ea8c6d1fd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:41.012509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778274e-f0b3-4620-a39f-d04ea8c6d1fd None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:41.014546 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 281/546] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:41.019676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5731-2007-4ee1-bff7-078be1972f2f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:41.019962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5731-2007-4ee1-bff7-078be1972f2f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:41.020238 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5731-2007-4ee1-bff7-078be1972f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:41.053434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-70cf5731-2007-4ee1-bff7-078be1972f2f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:41.054667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-70cf5731-2007-4ee1-bff7-078be1972f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:41.159857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b120159-6cdf-4351-86a6-85eca09dfcdd None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:41.204074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 282/547] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:41.210808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146a6d6-9571-4fd0-aa4c-61ab9c45d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:41.211908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146a6d6-9571-4fd0-aa4c-61ab9c45d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:41.212427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146a6d6-9571-4fd0-aa4c-61ab9c45d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:41.212903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146a6d6-9571-4fd0-aa4c-61ab9c45d7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:41.224475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146a6d6-9571-4fd0-aa4c-61ab9c45d7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:41.226272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146a6d6-9571-4fd0-aa4c-61ab9c45d7f1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:41.250417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-8146a6d6-9571-4fd0-aa4c-61ab9c45d7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:41.252216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 266/548] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:41.257932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf5731-2007-4ee1-bff7-078be1972f2f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:41.297580 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146a6d6-9571-4fd0-aa4c-61ab9c45d7f1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:41.389496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf5731-2007-4ee1-bff7-078be1972f2f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:41.435801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751607-5ad0-48fe-a18c-ed6a395fd218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:41.436884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751607-5ad0-48fe-a18c-ed6a395fd218 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:41.437329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751607-5ad0-48fe-a18c-ed6a395fd218 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:41.437765 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751607-5ad0-48fe-a18c-ed6a395fd218 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:41.444830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751607-5ad0-48fe-a18c-ed6a395fd218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:41.445422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751607-5ad0-48fe-a18c-ed6a395fd218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:41.447104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751607-5ad0-48fe-a18c-ed6a395fd218 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:41.476714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 283/549] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:41.481639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751607-5ad0-48fe-a18c-ed6a395fd218 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:41.486093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146a6d6-9571-4fd0-aa4c-61ab9c45d7f1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:41.531735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c48a4-3b18-4962-9ed2-855fc5d20a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:41.532806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c48a4-3b18-4962-9ed2-855fc5d20a7b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:41.533250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c48a4-3b18-4962-9ed2-855fc5d20a7b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:41.533682 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c48a4-3b18-4962-9ed2-855fc5d20a7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:41.553343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c48a4-3b18-4962-9ed2-855fc5d20a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:41.570516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-082c48a4-3b18-4962-9ed2-855fc5d20a7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:41.572728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 267/550] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:41.581925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c48a4-3b18-4962-9ed2-855fc5d20a7b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:41.642022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751607-5ad0-48fe-a18c-ed6a395fd218 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:41.685864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef547cd-a433-4308-9158-aa9c2f357181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:41.686962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef547cd-a433-4308-9158-aa9c2f357181 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:41.687411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef547cd-a433-4308-9158-aa9c2f357181 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:41.687846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef547cd-a433-4308-9158-aa9c2f357181 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:41.703760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef547cd-a433-4308-9158-aa9c2f357181 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:41.706421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef547cd-a433-4308-9158-aa9c2f357181 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:41.731182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-1ef547cd-a433-4308-9158-aa9c2f357181 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 17:11:41.732468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 284/551] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:41.737985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef547cd-a433-4308-9158-aa9c2f357181 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:41.768513 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c48a4-3b18-4962-9ed2-855fc5d20a7b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:41.809738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3c715-2a1d-41bc-a578-7cea51bc8185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:41.810986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3c715-2a1d-41bc-a578-7cea51bc8185 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:41.815744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3c715-2a1d-41bc-a578-7cea51bc8185 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:41.816178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3c715-2a1d-41bc-a578-7cea51bc8185 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:41.817119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3c715-2a1d-41bc-a578-7cea51bc8185 None admin] RBAC: Adding query filter params (name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:41.819051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3c715-2a1d-41bc-a578-7cea51bc8185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:41.822522 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3c715-2a1d-41bc-a578-7cea51bc8185 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:41.842298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 268/552] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:41.848755 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3c715-2a1d-41bc-a578-7cea51bc8185 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:41.908511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef547cd-a433-4308-9158-aa9c2f357181 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:41.943058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d2023-76bc-4c7f-86c4-b9caa0de52ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:41.944592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d2023-76bc-4c7f-86c4-b9caa0de52ba None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:41.945023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d2023-76bc-4c7f-86c4-b9caa0de52ba None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:41.945442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d2023-76bc-4c7f-86c4-b9caa0de52ba None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:41.946445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d2023-76bc-4c7f-86c4-b9caa0de52ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:41.946900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d2023-76bc-4c7f-86c4-b9caa0de52ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:41.948468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d2023-76bc-4c7f-86c4-b9caa0de52ba None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:41.965951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3c715-2a1d-41bc-a578-7cea51bc8185 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:41.986397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 285/553] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Mar 10 17:11:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:41.987927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4bc2-7a4f-43eb-b65b-fe0a2ac7aa71 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:41.988365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4bc2-7a4f-43eb-b65b-fe0a2ac7aa71 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:41.988803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4bc2-7a4f-43eb-b65b-fe0a2ac7aa71 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:41.991048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 286/554] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:41.991888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb4bc2-7a4f-43eb-b65b-fe0a2ac7aa71 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.013403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705ea4a-c7e4-4729-ba80-506c7fe48a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.014515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ea4a-c7e4-4729-ba80-506c7fe48a57 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.014801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ea4a-c7e4-4729-ba80-506c7fe48a57 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.015083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ea4a-c7e4-4729-ba80-506c7fe48a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.029444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705ea4a-c7e4-4729-ba80-506c7fe48a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:42.030929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705ea4a-c7e4-4729-ba80-506c7fe48a57 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:42.052142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-0705ea4a-c7e4-4729-ba80-506c7fe48a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:42.054189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 269/555] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:42.055655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4e8b4-581d-45e4-9a61-d822e9f69387 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.056074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4e8b4-581d-45e4-9a61-d822e9f69387 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.056357 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4e8b4-581d-45e4-9a61-d822e9f69387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.077660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-78c4e8b4-581d-45e4-9a61-d822e9f69387 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:42.079213 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-78c4e8b4-581d-45e4-9a61-d822e9f69387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:42.101330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb4bc2-7a4f-43eb-b65b-fe0a2ac7aa71 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:42.136216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eaf854-f4d7-4de4-bb39-fab1bb6c69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.137292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaf854-f4d7-4de4-bb39-fab1bb6c69da None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.137834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaf854-f4d7-4de4-bb39-fab1bb6c69da None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.138355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaf854-f4d7-4de4-bb39-fab1bb6c69da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.166142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 270/556] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:42.166142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4e8b4-581d-45e4-9a61-d822e9f69387 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.230785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eaf854-f4d7-4de4-bb39-fab1bb6c69da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:42.232754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eaf854-f4d7-4de4-bb39-fab1bb6c69da None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:42.279337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4e8b4-581d-45e4-9a61-d822e9f69387 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:42.318373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0ace-4728-437f-a1c3-7f6814eecc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.319612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0ace-4728-437f-a1c3-7f6814eecc8a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.319897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0ace-4728-437f-a1c3-7f6814eecc8a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.320178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0ace-4728-437f-a1c3-7f6814eecc8a None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.320903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f0ace-4728-437f-a1c3-7f6814eecc8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:42.321204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f0ace-4728-437f-a1c3-7f6814eecc8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:42.322611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f0ace-4728-437f-a1c3-7f6814eecc8a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:42.333938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 271/557] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:42.334782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0ace-4728-437f-a1c3-7f6814eecc8a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.351261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 287/558] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:42.353085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02ea55-b080-49a3-b03b-7973a8f3b085 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.353849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02ea55-b080-49a3-b03b-7973a8f3b085 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.354353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02ea55-b080-49a3-b03b-7973a8f3b085 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.356256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 288/559] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:42.357604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02ea55-b080-49a3-b03b-7973a8f3b085 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.431353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0ace-4728-437f-a1c3-7f6814eecc8a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:42.463322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5bd8d-5d48-4a76-ade8-f5cc7f876604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.463932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02ea55-b080-49a3-b03b-7973a8f3b085 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:42.464108 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5bd8d-5d48-4a76-ade8-f5cc7f876604 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.464391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5bd8d-5d48-4a76-ade8-f5cc7f876604 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.464663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5bd8d-5d48-4a76-ade8-f5cc7f876604 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.475185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5bd8d-5d48-4a76-ade8-f5cc7f876604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:42.482020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-83a5bd8d-5d48-4a76-ade8-f5cc7f876604 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:42.483223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 272/560] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:42.483988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5bd8d-5d48-4a76-ade8-f5cc7f876604 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.501935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca8f61-e297-4f5d-be36-38b363d4e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.502762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca8f61-e297-4f5d-be36-38b363d4e139 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.503041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca8f61-e297-4f5d-be36-38b363d4e139 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.503314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca8f61-e297-4f5d-be36-38b363d4e139 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.510339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca8f61-e297-4f5d-be36-38b363d4e139 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:42.511798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca8f61-e297-4f5d-be36-38b363d4e139 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:42.526847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-1cca8f61-e297-4f5d-be36-38b363d4e139 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 17:11:42.528027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 289/561] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Mar 10 17:11:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:42.529197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417a44-a9dd-40c2-8797-7123671d846b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.529533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417a44-a9dd-40c2-8797-7123671d846b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.529754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417a44-a9dd-40c2-8797-7123671d846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.546440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-21417a44-a9dd-40c2-8797-7123671d846b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:42.547889 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-21417a44-a9dd-40c2-8797-7123671d846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:42.584523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5bd8d-5d48-4a76-ade8-f5cc7f876604 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:42.610430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 290/562] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:42.611253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21417a44-a9dd-40c2-8797-7123671d846b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.623870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bfa2c-78c8-4466-ad33-b569f2dd3bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.624862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bfa2c-78c8-4466-ad33-b569f2dd3bab None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.625304 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bfa2c-78c8-4466-ad33-b569f2dd3bab None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.625586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bfa2c-78c8-4466-ad33-b569f2dd3bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.636269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bfa2c-78c8-4466-ad33-b569f2dd3bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:42.637748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bfa2c-78c8-4466-ad33-b569f2dd3bab None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:42.653534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-630bfa2c-78c8-4466-ad33-b569f2dd3bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:42.654714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 273/563] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:42.655488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bfa2c-78c8-4466-ad33-b569f2dd3bab None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.707266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21417a44-a9dd-40c2-8797-7123671d846b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:42.738659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68458b16-4b0b-4e79-96fe-598d951f7883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.739318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458b16-4b0b-4e79-96fe-598d951f7883 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.739601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458b16-4b0b-4e79-96fe-598d951f7883 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.739878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458b16-4b0b-4e79-96fe-598d951f7883 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.741177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68458b16-4b0b-4e79-96fe-598d951f7883 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:42.741483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68458b16-4b0b-4e79-96fe-598d951f7883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:42.742868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68458b16-4b0b-4e79-96fe-598d951f7883 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:42.748470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bfa2c-78c8-4466-ad33-b569f2dd3bab None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:42.750373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 291/564] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:42.751628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132eee5-7e65-4c4d-9647-d455af2dc8bd None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.751913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132eee5-7e65-4c4d-9647-d455af2dc8bd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.752189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132eee5-7e65-4c4d-9647-d455af2dc8bd None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.753819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 292/565] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:42.754630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132eee5-7e65-4c4d-9647-d455af2dc8bd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.784544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239fad-918d-45e3-99b3-22ed903f858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.785140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239fad-918d-45e3-99b3-22ed903f858b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.785426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239fad-918d-45e3-99b3-22ed903f858b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.785703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239fad-918d-45e3-99b3-22ed903f858b None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.786565 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f239fad-918d-45e3-99b3-22ed903f858b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:42.786877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f239fad-918d-45e3-99b3-22ed903f858b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:42.788893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f239fad-918d-45e3-99b3-22ed903f858b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:42.806776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 274/566] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Mar 10 17:11:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:42.807772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239fad-918d-45e3-99b3-22ed903f858b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.850144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132eee5-7e65-4c4d-9647-d455af2dc8bd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:42.881966 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f687-275d-4722-a784-28edec9faabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.882786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f687-275d-4722-a784-28edec9faabc None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.883076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f687-275d-4722-a784-28edec9faabc None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.883357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f687-275d-4722-a784-28edec9faabc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.894926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85f687-275d-4722-a784-28edec9faabc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:42.902340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-cd85f687-275d-4722-a784-28edec9faabc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:42.903510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 293/567] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:42.904273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f687-275d-4722-a784-28edec9faabc None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:42.904643 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239fad-918d-45e3-99b3-22ed903f858b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:42.937283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d06c45-21eb-4947-a778-1774363a0103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:42.937934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d06c45-21eb-4947-a778-1774363a0103 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.938248 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d06c45-21eb-4947-a778-1774363a0103 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.938525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d06c45-21eb-4947-a778-1774363a0103 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.939232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d06c45-21eb-4947-a778-1774363a0103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:42.939541 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d06c45-21eb-4947-a778-1774363a0103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:42.940892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d06c45-21eb-4947-a778-1774363a0103 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:42.951446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 275/568] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:42.952599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784b01-5983-4bea-b37d-7e8894f30f05 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:42.952889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784b01-5983-4bea-b37d-7e8894f30f05 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:42.953161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784b01-5983-4bea-b37d-7e8894f30f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:42.969345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-90784b01-5983-4bea-b37d-7e8894f30f05 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:42.970534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-90784b01-5983-4bea-b37d-7e8894f30f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:43.003182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f687-275d-4722-a784-28edec9faabc None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.034211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed2b7d-d5be-48c2-b239-07357a1afe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.034705 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 276/569] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:43.034999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed2b7d-d5be-48c2-b239-07357a1afe66 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.035286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed2b7d-d5be-48c2-b239-07357a1afe66 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.035468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90784b01-5983-4bea-b37d-7e8894f30f05 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.035568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed2b7d-d5be-48c2-b239-07357a1afe66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.048524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed2b7d-d5be-48c2-b239-07357a1afe66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.050207 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed2b7d-d5be-48c2-b239-07357a1afe66 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.067396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-07ed2b7d-d5be-48c2-b239-07357a1afe66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:43.068843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 294/570] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:43.069607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed2b7d-d5be-48c2-b239-07357a1afe66 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.129304 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90784b01-5983-4bea-b37d-7e8894f30f05 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.160653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc1128-a497-4b9a-beb0-e32e0453569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.161430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc1128-a497-4b9a-beb0-e32e0453569c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.161716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc1128-a497-4b9a-beb0-e32e0453569c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.161882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed2b7d-d5be-48c2-b239-07357a1afe66 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.162334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc1128-a497-4b9a-beb0-e32e0453569c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.172490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc1128-a497-4b9a-beb0-e32e0453569c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.173936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc1128-a497-4b9a-beb0-e32e0453569c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.190689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-debc1128-a497-4b9a-beb0-e32e0453569c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:43.191827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 277/571] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:43.192585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc1128-a497-4b9a-beb0-e32e0453569c None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.195630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49741313-16dc-4488-bfbf-b8466c2d0d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.196381 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49741313-16dc-4488-bfbf-b8466c2d0d33 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.196663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49741313-16dc-4488-bfbf-b8466c2d0d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.196942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49741313-16dc-4488-bfbf-b8466c2d0d33 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.197678 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49741313-16dc-4488-bfbf-b8466c2d0d33 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:43.197983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49741313-16dc-4488-bfbf-b8466c2d0d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.199389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49741313-16dc-4488-bfbf-b8466c2d0d33 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.207196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 295/572] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:43.207890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49741313-16dc-4488-bfbf-b8466c2d0d33 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.290867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc1128-a497-4b9a-beb0-e32e0453569c None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.304307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49741313-16dc-4488-bfbf-b8466c2d0d33 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.320670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba75e7-de20-487c-b345-a705e1a5bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.321458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba75e7-de20-487c-b345-a705e1a5bff0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.321739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba75e7-de20-487c-b345-a705e1a5bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.322018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba75e7-de20-487c-b345-a705e1a5bff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.328379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba75e7-de20-487c-b345-a705e1a5bff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.329801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba75e7-de20-487c-b345-a705e1a5bff0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.335977 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee981a1-f6e6-45d5-8b43-b377ce97910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.336770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee981a1-f6e6-45d5-8b43-b377ce97910a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.337055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee981a1-f6e6-45d5-8b43-b377ce97910a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.337328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee981a1-f6e6-45d5-8b43-b377ce97910a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.342902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-7aba75e7-de20-487c-b345-a705e1a5bff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:43.344196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 278/573] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:43.344870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba75e7-de20-487c-b345-a705e1a5bff0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.347016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee981a1-f6e6-45d5-8b43-b377ce97910a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:43.354284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-6ee981a1-f6e6-45d5-8b43-b377ce97910a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:43.355485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 296/574] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:43.356242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee981a1-f6e6-45d5-8b43-b377ce97910a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.436909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba75e7-de20-487c-b345-a705e1a5bff0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.448326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee981a1-f6e6-45d5-8b43-b377ce97910a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.468671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcf53d-7fa5-4c7d-9923-fc4ce5ca6ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.469320 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf53d-7fa5-4c7d-9923-fc4ce5ca6ced None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.469602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf53d-7fa5-4c7d-9923-fc4ce5ca6ced None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.469877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf53d-7fa5-4c7d-9923-fc4ce5ca6ced None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.470616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcf53d-7fa5-4c7d-9923-fc4ce5ca6ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:43.470917 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcf53d-7fa5-4c7d-9923-fc4ce5ca6ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.472280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcf53d-7fa5-4c7d-9923-fc4ce5ca6ced None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.479883 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f62f3-cddf-4a09-9492-8f743dc476fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.480540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f62f3-cddf-4a09-9492-8f743dc476fe None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.480825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f62f3-cddf-4a09-9492-8f743dc476fe None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.481101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f62f3-cddf-4a09-9492-8f743dc476fe None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.481841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f62f3-cddf-4a09-9492-8f743dc476fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:43.482199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f62f3-cddf-4a09-9492-8f743dc476fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.483446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 279/575] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:43.483565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f62f3-cddf-4a09-9492-8f743dc476fe None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.484220 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcf53d-7fa5-4c7d-9923-fc4ce5ca6ced None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.494896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 297/576] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:43.495687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f62f3-cddf-4a09-9492-8f743dc476fe None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.575739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcf53d-7fa5-4c7d-9923-fc4ce5ca6ced None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.589894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f62f3-cddf-4a09-9492-8f743dc476fe None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.607125 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfe86b-ac62-4966-9979-623b8593cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.607902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe86b-ac62-4966-9979-623b8593cf36 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.608189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe86b-ac62-4966-9979-623b8593cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.608460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe86b-ac62-4966-9979-623b8593cf36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.618386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfe86b-ac62-4966-9979-623b8593cf36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.619819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfe86b-ac62-4966-9979-623b8593cf36 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.621323 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6a4a2-1c56-4ce0-b8bc-6ab4bed519c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.621966 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6a4a2-1c56-4ce0-b8bc-6ab4bed519c9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.622283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6a4a2-1c56-4ce0-b8bc-6ab4bed519c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.622557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6a4a2-1c56-4ce0-b8bc-6ab4bed519c9 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.623323 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6a4a2-1c56-4ce0-b8bc-6ab4bed519c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:43.623628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6a4a2-1c56-4ce0-b8bc-6ab4bed519c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.625019 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6a4a2-1c56-4ce0-b8bc-6ab4bed519c9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.636379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-dccfe86b-ac62-4966-9979-623b8593cf36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:43.636507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 298/577] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:43.637249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6a4a2-1c56-4ce0-b8bc-6ab4bed519c9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.642185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 280/578] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:43.642185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfe86b-ac62-4966-9979-623b8593cf36 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.728390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfe86b-ac62-4966-9979-623b8593cf36 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.733357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6a4a2-1c56-4ce0-b8bc-6ab4bed519c9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.759767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2efd-2441-49c6-9195-d04a44409e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.760542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2efd-2441-49c6-9195-d04a44409e7b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.760821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2efd-2441-49c6-9195-d04a44409e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.761096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2efd-2441-49c6-9195-d04a44409e7b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.765363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd248751-183a-48bf-acae-5b4e35ecb624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.766021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd248751-183a-48bf-acae-5b4e35ecb624 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.766334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd248751-183a-48bf-acae-5b4e35ecb624 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.766613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd248751-183a-48bf-acae-5b4e35ecb624 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.767349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd248751-183a-48bf-acae-5b4e35ecb624 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:43.767653 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd248751-183a-48bf-acae-5b4e35ecb624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.768145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a2efd-2441-49c6-9195-d04a44409e7b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.769292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd248751-183a-48bf-acae-5b4e35ecb624 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.769574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a2efd-2441-49c6-9195-d04a44409e7b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.776878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 299/579] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:43.777641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd248751-183a-48bf-acae-5b4e35ecb624 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.782446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-f15a2efd-2441-49c6-9195-d04a44409e7b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 10 17:11:43.783597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 281/580] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:43.784350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2efd-2441-49c6-9195-d04a44409e7b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.871938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd248751-183a-48bf-acae-5b4e35ecb624 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.877889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2efd-2441-49c6-9195-d04a44409e7b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:43.903897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c11217-5401-41c1-abaf-8836e94132e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.904683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c11217-5401-41c1-abaf-8836e94132e8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.904964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c11217-5401-41c1-abaf-8836e94132e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.905239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c11217-5401-41c1-abaf-8836e94132e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.909538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2b60e-1fc5-422e-881f-d9d9fc8f2f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:43.910209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b60e-1fc5-422e-881f-d9d9fc8f2f0b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:43.910494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b60e-1fc5-422e-881f-d9d9fc8f2f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:43.910767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b60e-1fc5-422e-881f-d9d9fc8f2f0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:43.911540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c11217-5401-41c1-abaf-8836e94132e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.911639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2b60e-1fc5-422e-881f-d9d9fc8f2f0b None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=35cc9fe9f62844a38f78d52435186f26) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:43.911872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2b60e-1fc5-422e-881f-d9d9fc8f2f0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:43.913006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c11217-5401-41c1-abaf-8836e94132e8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.913362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2b60e-1fc5-422e-881f-d9d9fc8f2f0b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:43.918407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 282/581] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/role_assignments?user.id=35cc9fe9f62844a38f78d52435186f26&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:43.919171 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2b60e-1fc5-422e-881f-d9d9fc8f2f0b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:43.926562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-a1c11217-5401-41c1-abaf-8836e94132e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:43.932953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 300/582] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:43.932953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c11217-5401-41c1-abaf-8836e94132e8 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.031253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2b60e-1fc5-422e-881f-d9d9fc8f2f0b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.037602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c11217-5401-41c1-abaf-8836e94132e8 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.068272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc7705-9f0d-4482-81f8-3d3de5dc90a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.068985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc7705-9f0d-4482-81f8-3d3de5dc90a7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.069263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc7705-9f0d-4482-81f8-3d3de5dc90a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.069524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc7705-9f0d-4482-81f8-3d3de5dc90a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.070287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc7705-9f0d-4482-81f8-3d3de5dc90a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:44.070594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc7705-9f0d-4482-81f8-3d3de5dc90a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.071968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc7705-9f0d-4482-81f8-3d3de5dc90a7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.076499 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb5bfc-bb1c-46ba-85ad-9892032c84a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.077317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb5bfc-bb1c-46ba-85ad-9892032c84a9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.077600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb5bfc-bb1c-46ba-85ad-9892032c84a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.077878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb5bfc-bb1c-46ba-85ad-9892032c84a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.088760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 283/583] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:44.088760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc7705-9f0d-4482-81f8-3d3de5dc90a7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.093493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb5bfc-bb1c-46ba-85ad-9892032c84a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.095007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb5bfc-bb1c-46ba-85ad-9892032c84a9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.112356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-c9fb5bfc-bb1c-46ba-85ad-9892032c84a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:44.113702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 301/584] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:44.114404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb5bfc-bb1c-46ba-85ad-9892032c84a9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.187947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc7705-9f0d-4482-81f8-3d3de5dc90a7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.211588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb5bfc-bb1c-46ba-85ad-9892032c84a9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.226673 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe440f5-5da9-42e8-9042-6e26621f79eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.227347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe440f5-5da9-42e8-9042-6e26621f79eb None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.227629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe440f5-5da9-42e8-9042-6e26621f79eb None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.227908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe440f5-5da9-42e8-9042-6e26621f79eb None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.228743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe440f5-5da9-42e8-9042-6e26621f79eb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:44.229047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe440f5-5da9-42e8-9042-6e26621f79eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.230507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe440f5-5da9-42e8-9042-6e26621f79eb None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.244139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b168f4a-562e-4777-bce3-c5d01e9ac516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.244811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b168f4a-562e-4777-bce3-c5d01e9ac516 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.245122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b168f4a-562e-4777-bce3-c5d01e9ac516 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.245365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b168f4a-562e-4777-bce3-c5d01e9ac516 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.246169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b168f4a-562e-4777-bce3-c5d01e9ac516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:44.246477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b168f4a-562e-4777-bce3-c5d01e9ac516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.247882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b168f4a-562e-4777-bce3-c5d01e9ac516 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.252605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 284/585] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:44.252605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe440f5-5da9-42e8-9042-6e26621f79eb None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.263607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 302/586] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:44.264420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b168f4a-562e-4777-bce3-c5d01e9ac516 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.353491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe440f5-5da9-42e8-9042-6e26621f79eb None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.364638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b168f4a-562e-4777-bce3-c5d01e9ac516 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.387463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d469f51-43e3-4d62-b828-82ffcfb62fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.388523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469f51-43e3-4d62-b828-82ffcfb62fc0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.388814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469f51-43e3-4d62-b828-82ffcfb62fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.389244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469f51-43e3-4d62-b828-82ffcfb62fc0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.397288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426193-4d71-402a-9452-e55d179783db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.397763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d469f51-43e3-4d62-b828-82ffcfb62fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.397987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426193-4d71-402a-9452-e55d179783db None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.398250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426193-4d71-402a-9452-e55d179783db None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.398525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426193-4d71-402a-9452-e55d179783db None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.399232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d426193-4d71-402a-9452-e55d179783db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:44.399323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d469f51-43e3-4d62-b828-82ffcfb62fc0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.399535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d426193-4d71-402a-9452-e55d179783db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.400889 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d426193-4d71-402a-9452-e55d179783db None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.411585 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 303/587] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:44.412915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426193-4d71-402a-9452-e55d179783db None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.415718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-3d469f51-43e3-4d62-b828-82ffcfb62fc0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 10 17:11:44.417373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 285/588] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:44.418198 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d469f51-43e3-4d62-b828-82ffcfb62fc0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.510260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426193-4d71-402a-9452-e55d179783db None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.515567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d469f51-43e3-4d62-b828-82ffcfb62fc0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.544335 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177d73a-ba9c-4521-a925-836028563ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.545164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177d73a-ba9c-4521-a925-836028563ccb None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.545449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177d73a-ba9c-4521-a925-836028563ccb None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.545831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177d73a-ba9c-4521-a925-836028563ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.550159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cb955-4d4b-4b5c-a751-b085b1b41527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.551047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb955-4d4b-4b5c-a751-b085b1b41527 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.551329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb955-4d4b-4b5c-a751-b085b1b41527 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.551605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb955-4d4b-4b5c-a751-b085b1b41527 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/89a64b4a57114f77a231a31e16b3923e/roles/f7e74696bb6d4f4e8571a49a6c5335c8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.558572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177d73a-ba9c-4521-a925-836028563ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.560101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177d73a-ba9c-4521-a925-836028563ccb None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.565909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb955-4d4b-4b5c-a751-b085b1b41527 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=89a64b4a57114f77a231a31e16b3923e, role_id=f7e74696bb6d4f4e8571a49a6c5335c8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.567381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb955-4d4b-4b5c-a751-b085b1b41527 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.577543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-5177d73a-ba9c-4521-a925-836028563ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:44.578818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 304/589] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:44.583826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177d73a-ba9c-4521-a925-836028563ccb None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.590205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 286/590] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:11:44 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/89a64b4a57114f77a231a31e16b3923e/roles/f7e74696bb6d4f4e8571a49a6c5335c8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:44.591660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cb955-4d4b-4b5c-a751-b085b1b41527 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.697835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177d73a-ba9c-4521-a925-836028563ccb None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.726750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cb955-4d4b-4b5c-a751-b085b1b41527 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.738047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f14d3-9560-48ba-843e-a29fde230d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.739501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f14d3-9560-48ba-843e-a29fde230d4f None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.739928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f14d3-9560-48ba-843e-a29fde230d4f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.740390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f14d3-9560-48ba-843e-a29fde230d4f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.749091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f14d3-9560-48ba-843e-a29fde230d4f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.750852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f14d3-9560-48ba-843e-a29fde230d4f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.766514 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2b2b5-02c8-45c3-a2ac-569ccfc0e74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.766727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2b2b5-02c8-45c3-a2ac-569ccfc0e74a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.767104 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2b2b5-02c8-45c3-a2ac-569ccfc0e74a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.767473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2b2b5-02c8-45c3-a2ac-569ccfc0e74a None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.768057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-b38f14d3-9560-48ba-843e-a29fde230d4f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 10 17:11:44.768523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2b2b5-02c8-45c3-a2ac-569ccfc0e74a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:44.768924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2b2b5-02c8-45c3-a2ac-569ccfc0e74a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.770016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 305/591] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:44.770553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2b2b5-02c8-45c3-a2ac-569ccfc0e74a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.771154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f14d3-9560-48ba-843e-a29fde230d4f None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.789903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 287/592] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:44.790896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2b2b5-02c8-45c3-a2ac-569ccfc0e74a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.879475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f14d3-9560-48ba-843e-a29fde230d4f None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.913928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34067476-3103-41d5-b12f-78cedcb8d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.914159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2b2b5-02c8-45c3-a2ac-569ccfc0e74a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:44.915339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34067476-3103-41d5-b12f-78cedcb8d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.915774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34067476-3103-41d5-b12f-78cedcb8d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.916246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34067476-3103-41d5-b12f-78cedcb8d7b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.917099 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34067476-3103-41d5-b12f-78cedcb8d7b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:44.917543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34067476-3103-41d5-b12f-78cedcb8d7b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.919099 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34067476-3103-41d5-b12f-78cedcb8d7b9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.931602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 306/593] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:44.932688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34067476-3103-41d5-b12f-78cedcb8d7b9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:44.965794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fcfb7-8d49-4401-8cbc-3a6b9f438825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:44.966503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fcfb7-8d49-4401-8cbc-3a6b9f438825 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:44.966840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fcfb7-8d49-4401-8cbc-3a6b9f438825 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:44.967049 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fcfb7-8d49-4401-8cbc-3a6b9f438825 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:44.967878 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fcfb7-8d49-4401-8cbc-3a6b9f438825 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:44.968180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fcfb7-8d49-4401-8cbc-3a6b9f438825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:44.969608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fcfb7-8d49-4401-8cbc-3a6b9f438825 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:44.987989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 288/594] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:44.988838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fcfb7-8d49-4401-8cbc-3a6b9f438825 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.036233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34067476-3103-41d5-b12f-78cedcb8d7b9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.072164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3fe83-5009-410d-81e9-677a16745672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.073321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3fe83-5009-410d-81e9-677a16745672 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.073825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3fe83-5009-410d-81e9-677a16745672 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.074317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3fe83-5009-410d-81e9-677a16745672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.085565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3fe83-5009-410d-81e9-677a16745672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.087328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3fe83-5009-410d-81e9-677a16745672 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.089300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fcfb7-8d49-4401-8cbc-3a6b9f438825 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.104676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-dfe3fe83-5009-410d-81e9-677a16745672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:45.106505 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 307/595] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:45.107549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3fe83-5009-410d-81e9-677a16745672 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.123162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25986-29e2-465b-ab14-555cc476ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.123976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25986-29e2-465b-ab14-555cc476ec50 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.124256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25986-29e2-465b-ab14-555cc476ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.124530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25986-29e2-465b-ab14-555cc476ec50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.132586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b25986-29e2-465b-ab14-555cc476ec50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.134044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b25986-29e2-465b-ab14-555cc476ec50 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.147232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-81b25986-29e2-465b-ab14-555cc476ec50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:45.153007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 289/596] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:45.153857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25986-29e2-465b-ab14-555cc476ec50 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.209515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3fe83-5009-410d-81e9-677a16745672 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.248532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0ed63-5e24-4e2e-b179-64797cb951c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.248982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0ed63-5e24-4e2e-b179-64797cb951c9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.249268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0ed63-5e24-4e2e-b179-64797cb951c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.249542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0ed63-5e24-4e2e-b179-64797cb951c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.264165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0ed63-5e24-4e2e-b179-64797cb951c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.265630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0ed63-5e24-4e2e-b179-64797cb951c9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.274421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25986-29e2-465b-ab14-555cc476ec50 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.282149 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-37d0ed63-5e24-4e2e-b179-64797cb951c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:45.284147 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 308/597] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:45.284929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0ed63-5e24-4e2e-b179-64797cb951c9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.310251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ddf91-ec14-4f66-a9f8-558cad774f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.311023 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ddf91-ec14-4f66-a9f8-558cad774f91 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.311401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ddf91-ec14-4f66-a9f8-558cad774f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.311789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ddf91-ec14-4f66-a9f8-558cad774f91 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.312763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ddf91-ec14-4f66-a9f8-558cad774f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:45.312996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ddf91-ec14-4f66-a9f8-558cad774f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.314484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ddf91-ec14-4f66-a9f8-558cad774f91 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.327004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 290/598] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:45.327803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ddf91-ec14-4f66-a9f8-558cad774f91 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.392268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0ed63-5e24-4e2e-b179-64797cb951c9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.426174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f57bb-7aa5-438e-82ab-acdca8e973b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.427124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f57bb-7aa5-438e-82ab-acdca8e973b7 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.427554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f57bb-7aa5-438e-82ab-acdca8e973b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.428514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f57bb-7aa5-438e-82ab-acdca8e973b7 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.428626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ddf91-ec14-4f66-a9f8-558cad774f91 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.429562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f57bb-7aa5-438e-82ab-acdca8e973b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:45.430031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f57bb-7aa5-438e-82ab-acdca8e973b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.431633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f57bb-7aa5-438e-82ab-acdca8e973b7 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.449544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 309/599] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:45.450756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f57bb-7aa5-438e-82ab-acdca8e973b7 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.463688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d09d57-25d6-4176-a005-d400016aefa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.464487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d09d57-25d6-4176-a005-d400016aefa7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.464880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d09d57-25d6-4176-a005-d400016aefa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.465216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d09d57-25d6-4176-a005-d400016aefa7 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.466010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d09d57-25d6-4176-a005-d400016aefa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:45.466428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d09d57-25d6-4176-a005-d400016aefa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.468116 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d09d57-25d6-4176-a005-d400016aefa7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.481183 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 291/600] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:45.482089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d09d57-25d6-4176-a005-d400016aefa7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.554926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f57bb-7aa5-438e-82ab-acdca8e973b7 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.585321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d09d57-25d6-4176-a005-d400016aefa7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.591339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daedb7e-1f4c-40e1-a72d-24456cfb2b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.592449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daedb7e-1f4c-40e1-a72d-24456cfb2b61 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.592933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daedb7e-1f4c-40e1-a72d-24456cfb2b61 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.593406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daedb7e-1f4c-40e1-a72d-24456cfb2b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.601197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daedb7e-1f4c-40e1-a72d-24456cfb2b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.602941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daedb7e-1f4c-40e1-a72d-24456cfb2b61 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.616989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-9daedb7e-1f4c-40e1-a72d-24456cfb2b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:45.619291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 310/601] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:45.620227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d61476-c28b-468c-800b-16c54d61b604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.620616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daedb7e-1f4c-40e1-a72d-24456cfb2b61 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.621157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d61476-c28b-468c-800b-16c54d61b604 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.621401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d61476-c28b-468c-800b-16c54d61b604 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.621797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d61476-c28b-468c-800b-16c54d61b604 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/9f582002cd7141428072dacd218dbe86/roles/f7e74696bb6d4f4e8571a49a6c5335c8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.637003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d61476-c28b-468c-800b-16c54d61b604 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=9f582002cd7141428072dacd218dbe86, role_id=f7e74696bb6d4f4e8571a49a6c5335c8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.638484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d61476-c28b-468c-800b-16c54d61b604 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.662566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 292/602] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:11:45 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/9f582002cd7141428072dacd218dbe86/roles/f7e74696bb6d4f4e8571a49a6c5335c8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:45.662566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d61476-c28b-468c-800b-16c54d61b604 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.826267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daedb7e-1f4c-40e1-a72d-24456cfb2b61 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.875479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d61476-c28b-468c-800b-16c54d61b604 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:45.876938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b15ff-52ad-4e70-b745-e02b0cc324bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.878015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b15ff-52ad-4e70-b745-e02b0cc324bb None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.878516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b15ff-52ad-4e70-b745-e02b0cc324bb None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.878984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b15ff-52ad-4e70-b745-e02b0cc324bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.888361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b15ff-52ad-4e70-b745-e02b0cc324bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.890499 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b15ff-52ad-4e70-b745-e02b0cc324bb None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.905955 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-a45b15ff-52ad-4e70-b745-e02b0cc324bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:45.908094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 311/603] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:45.912599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62733f6-93b9-41aa-afbc-9f0365eb208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:45.913256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62733f6-93b9-41aa-afbc-9f0365eb208b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:45.913536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62733f6-93b9-41aa-afbc-9f0365eb208b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:45.913808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62733f6-93b9-41aa-afbc-9f0365eb208b None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:45.914454 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b15ff-52ad-4e70-b745-e02b0cc324bb None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:45.914698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62733f6-93b9-41aa-afbc-9f0365eb208b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:45.915117 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62733f6-93b9-41aa-afbc-9f0365eb208b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:45.916456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62733f6-93b9-41aa-afbc-9f0365eb208b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:45.930428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 293/604] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:45.936467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62733f6-93b9-41aa-afbc-9f0365eb208b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:46.040715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b15ff-52ad-4e70-b745-e02b0cc324bb None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:46.046352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62733f6-93b9-41aa-afbc-9f0365eb208b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:46.086646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978147ab-b7d6-406c-971f-e7075ae0d595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:46.087535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978147ab-b7d6-406c-971f-e7075ae0d595 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:46.087815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978147ab-b7d6-406c-971f-e7075ae0d595 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:46.088091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978147ab-b7d6-406c-971f-e7075ae0d595 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/ad9a11df2d3d4dc292a5115de69bb288/roles/f7e74696bb6d4f4e8571a49a6c5335c8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:46.089894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72ca4-ef67-437d-bd4f-491646d69f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:46.090577 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72ca4-ef67-437d-bd4f-491646d69f5c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:46.090869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72ca4-ef67-437d-bd4f-491646d69f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:46.091414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72ca4-ef67-437d-bd4f-491646d69f5c None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:46.092202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde72ca4-ef67-437d-bd4f-491646d69f5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:46.092507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde72ca4-ef67-437d-bd4f-491646d69f5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:46.094467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde72ca4-ef67-437d-bd4f-491646d69f5c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:46.105606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 312/605] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:46.108347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978147ab-b7d6-406c-971f-e7075ae0d595 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=ad9a11df2d3d4dc292a5115de69bb288, role_id=f7e74696bb6d4f4e8571a49a6c5335c8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:46.109990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978147ab-b7d6-406c-971f-e7075ae0d595 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:46.111348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72ca4-ef67-437d-bd4f-491646d69f5c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:46.130308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 294/606] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:11:45 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/ad9a11df2d3d4dc292a5115de69bb288/roles/f7e74696bb6d4f4e8571a49a6c5335c8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:11:46.225516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72ca4-ef67-437d-bd4f-491646d69f5c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:46.262206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2fad4-3668-4c66-a430-507cf96d8c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:46.263217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2fad4-3668-4c66-a430-507cf96d8c76 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:46.263500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2fad4-3668-4c66-a430-507cf96d8c76 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:46.263776 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2fad4-3668-4c66-a430-507cf96d8c76 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/701c0e43cc30442582456f4f7153333a/roles/f7e74696bb6d4f4e8571a49a6c5335c8` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:46.280461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2fad4-3668-4c66-a430-507cf96d8c76 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=701c0e43cc30442582456f4f7153333a, role_id=f7e74696bb6d4f4e8571a49a6c5335c8)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:46.281918 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2fad4-3668-4c66-a430-507cf96d8c76 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:46.298254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 313/607] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:11:46 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/701c0e43cc30442582456f4f7153333a/roles/f7e74696bb6d4f4e8571a49a6c5335c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:46.390929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625715d8-21d8-485f-8614-4198aea1bd34 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:46.391140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625715d8-21d8-485f-8614-4198aea1bd34 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:46.391422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625715d8-21d8-485f-8614-4198aea1bd34 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:46.393540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 295/608] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:46.408162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe844b0f-7988-482a-b36f-7d829b018f25 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:46.408811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe844b0f-7988-482a-b36f-7d829b018f25 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:46.409287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe844b0f-7988-482a-b36f-7d829b018f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:46.428852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fe844b0f-7988-482a-b36f-7d829b018f25 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:46.430468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fe844b0f-7988-482a-b36f-7d829b018f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:46.506826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 314/609] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:46.531461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625715d8-21d8-485f-8614-4198aea1bd34 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:46.640478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625715d8-21d8-485f-8614-4198aea1bd34 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:46.673979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbd6ee-61b3-4d6b-a58d-bca483e6eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:46.674727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbd6ee-61b3-4d6b-a58d-bca483e6eca7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:46.675010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbd6ee-61b3-4d6b-a58d-bca483e6eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:46.675271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbd6ee-61b3-4d6b-a58d-bca483e6eca7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:46.685828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbd6ee-61b3-4d6b-a58d-bca483e6eca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:46.692836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-4bbbd6ee-61b3-4d6b-a58d-bca483e6eca7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:46.694913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 296/610] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:46.700912 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe844b0f-7988-482a-b36f-7d829b018f25 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:46.816546 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe844b0f-7988-482a-b36f-7d829b018f25 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:46.857718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a412e-d048-4d77-bb5b-104cbcf784e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:46.858521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a412e-d048-4d77-bb5b-104cbcf784e8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:46.858708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a412e-d048-4d77-bb5b-104cbcf784e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:46.858985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a412e-d048-4d77-bb5b-104cbcf784e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:46.859745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a412e-d048-4d77-bb5b-104cbcf784e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:46.860052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a412e-d048-4d77-bb5b-104cbcf784e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:46.861417 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a412e-d048-4d77-bb5b-104cbcf784e8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:46.874214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 315/611] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:46.879169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbd6ee-61b3-4d6b-a58d-bca483e6eca7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:47.019264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbd6ee-61b3-4d6b-a58d-bca483e6eca7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:47.067714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce390198-16a1-47e9-ab83-c91fff0c8d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:47.068890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce390198-16a1-47e9-ab83-c91fff0c8d48 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:47.069173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce390198-16a1-47e9-ab83-c91fff0c8d48 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:47.069448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce390198-16a1-47e9-ab83-c91fff0c8d48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:47.098354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce390198-16a1-47e9-ab83-c91fff0c8d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:47.100341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce390198-16a1-47e9-ab83-c91fff0c8d48 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:47.120786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-ce390198-16a1-47e9-ab83-c91fff0c8d48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:47.122981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 297/612] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:47.127591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a412e-d048-4d77-bb5b-104cbcf784e8 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:47.230310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a412e-d048-4d77-bb5b-104cbcf784e8 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:47.269702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc50a5e-e076-4015-86cb-f3cde449f881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:47.270324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50a5e-e076-4015-86cb-f3cde449f881 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:47.270609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50a5e-e076-4015-86cb-f3cde449f881 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:47.270888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50a5e-e076-4015-86cb-f3cde449f881 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:47.271651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc50a5e-e076-4015-86cb-f3cde449f881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:47.271963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc50a5e-e076-4015-86cb-f3cde449f881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:47.273325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc50a5e-e076-4015-86cb-f3cde449f881 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:47.285880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 316/613] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:47.292024 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce390198-16a1-47e9-ab83-c91fff0c8d48 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:47.435784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce390198-16a1-47e9-ab83-c91fff0c8d48 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:47.451350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dce68f-bd85-4096-8e2a-cbce3b0c274a None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:47.451650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dce68f-bd85-4096-8e2a-cbce3b0c274a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:47.451922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dce68f-bd85-4096-8e2a-cbce3b0c274a None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:47.455087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 317/614] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:47.459593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37840465-94f3-42b8-bc6f-1e143e0aadbd None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:47.459885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37840465-94f3-42b8-bc6f-1e143e0aadbd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:47.460168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37840465-94f3-42b8-bc6f-1e143e0aadbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:47.473448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a1edc-56f1-4ef0-8d12-a67d866f449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:47.474281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a1edc-56f1-4ef0-8d12-a67d866f449a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:47.474619 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a1edc-56f1-4ef0-8d12-a67d866f449a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:47.475458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a1edc-56f1-4ef0-8d12-a67d866f449a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:47.477875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-37840465-94f3-42b8-bc6f-1e143e0aadbd None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:47.479125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-37840465-94f3-42b8-bc6f-1e143e0aadbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:47.483393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a1edc-56f1-4ef0-8d12-a67d866f449a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:47.484833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a1edc-56f1-4ef0-8d12-a67d866f449a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:47.506661 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-861a1edc-56f1-4ef0-8d12-a67d866f449a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 17:11:47.508161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 298/615] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:47.513442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a1edc-56f1-4ef0-8d12-a67d866f449a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:47.554337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 318/616] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:47.576477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37840465-94f3-42b8-bc6f-1e143e0aadbd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:47.612875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a1edc-56f1-4ef0-8d12-a67d866f449a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:47.645841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332c801-7cfa-4923-89d7-b92f881a43d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:47.647050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332c801-7cfa-4923-89d7-b92f881a43d4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:47.647333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332c801-7cfa-4923-89d7-b92f881a43d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:47.647609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332c801-7cfa-4923-89d7-b92f881a43d4 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:47.648434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332c801-7cfa-4923-89d7-b92f881a43d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:47.648739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332c801-7cfa-4923-89d7-b92f881a43d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:47.650191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332c801-7cfa-4923-89d7-b92f881a43d4 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:47.667894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 299/617] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Mar 10 17:11:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:47.673576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332c801-7cfa-4923-89d7-b92f881a43d4 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:47.676703 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37840465-94f3-42b8-bc6f-1e143e0aadbd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:47.712803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494129a-fe2a-44af-a8d8-ceb03cbb5adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:47.713617 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494129a-fe2a-44af-a8d8-ceb03cbb5adc None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:47.713908 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494129a-fe2a-44af-a8d8-ceb03cbb5adc None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:47.714215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494129a-fe2a-44af-a8d8-ceb03cbb5adc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:47.726387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494129a-fe2a-44af-a8d8-ceb03cbb5adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:47.733592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-9494129a-fe2a-44af-a8d8-ceb03cbb5adc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:47.739690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 319/618] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:47.740973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494129a-fe2a-44af-a8d8-ceb03cbb5adc None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:47.842237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494129a-fe2a-44af-a8d8-ceb03cbb5adc None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:47.882919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332c801-7cfa-4923-89d7-b92f881a43d4 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:47.893104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d56b9-4b2c-4da5-a24d-4617dce01696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:47.893765 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d56b9-4b2c-4da5-a24d-4617dce01696 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:47.894232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d56b9-4b2c-4da5-a24d-4617dce01696 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:47.894390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d56b9-4b2c-4da5-a24d-4617dce01696 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:47.895084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d56b9-4b2c-4da5-a24d-4617dce01696 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:47.895390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d56b9-4b2c-4da5-a24d-4617dce01696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:47.896796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d56b9-4b2c-4da5-a24d-4617dce01696 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:47.917136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 320/619] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:47.918462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d56b9-4b2c-4da5-a24d-4617dce01696 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:47.958661 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584791f5-0f6c-4b8a-8fb9-2c2184855c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:47.959910 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584791f5-0f6c-4b8a-8fb9-2c2184855c17 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:47.960414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584791f5-0f6c-4b8a-8fb9-2c2184855c17 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:47.960903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584791f5-0f6c-4b8a-8fb9-2c2184855c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:47.978568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584791f5-0f6c-4b8a-8fb9-2c2184855c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:47.980503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584791f5-0f6c-4b8a-8fb9-2c2184855c17 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:48.016239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-584791f5-0f6c-4b8a-8fb9-2c2184855c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:48.017462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 300/620] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:48.022784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d56b9-4b2c-4da5-a24d-4617dce01696 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:48.025138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584791f5-0f6c-4b8a-8fb9-2c2184855c17 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:48.072945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff42f6-b89f-4f80-9bb8-8378fa6dd411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:48.073749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff42f6-b89f-4f80-9bb8-8378fa6dd411 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.074031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff42f6-b89f-4f80-9bb8-8378fa6dd411 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.074334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff42f6-b89f-4f80-9bb8-8378fa6dd411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.099828 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff42f6-b89f-4f80-9bb8-8378fa6dd411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:48.101223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff42f6-b89f-4f80-9bb8-8378fa6dd411 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:48.125899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-2dff42f6-b89f-4f80-9bb8-8378fa6dd411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:48.136841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 321/621] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:48.141927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff42f6-b89f-4f80-9bb8-8378fa6dd411 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:48.233697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584791f5-0f6c-4b8a-8fb9-2c2184855c17 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:48.270965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff42f6-b89f-4f80-9bb8-8378fa6dd411 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:48.309647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8375a-59c6-44b9-beae-7ad8afcadd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:48.309647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8375a-59c6-44b9-beae-7ad8afcadd6c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.309647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8375a-59c6-44b9-beae-7ad8afcadd6c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.309647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8375a-59c6-44b9-beae-7ad8afcadd6c None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.310125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8375a-59c6-44b9-beae-7ad8afcadd6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:48.310403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8375a-59c6-44b9-beae-7ad8afcadd6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:48.311770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8375a-59c6-44b9-beae-7ad8afcadd6c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:48.320132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904abf8-81d8-4877-b8e2-59c9bf88ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:48.320814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904abf8-81d8-4877-b8e2-59c9bf88ba81 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.321097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904abf8-81d8-4877-b8e2-59c9bf88ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.321372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904abf8-81d8-4877-b8e2-59c9bf88ba81 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.322116 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904abf8-81d8-4877-b8e2-59c9bf88ba81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:48.322434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904abf8-81d8-4877-b8e2-59c9bf88ba81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:48.323823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904abf8-81d8-4877-b8e2-59c9bf88ba81 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:48.324483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 322/622] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:48.331033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8375a-59c6-44b9-beae-7ad8afcadd6c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:48.351593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 301/623] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:48.355854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904abf8-81d8-4877-b8e2-59c9bf88ba81 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:48.489063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904abf8-81d8-4877-b8e2-59c9bf88ba81 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:48.526427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3739cef-524a-45f7-b4ef-638f036b8e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:48.527240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739cef-524a-45f7-b4ef-638f036b8e7d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.527595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739cef-524a-45f7-b4ef-638f036b8e7d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.527872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739cef-524a-45f7-b4ef-638f036b8e7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.535938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3739cef-524a-45f7-b4ef-638f036b8e7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:48.537493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3739cef-524a-45f7-b4ef-638f036b8e7d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:48.549965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8375a-59c6-44b9-beae-7ad8afcadd6c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:48.555225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-d3739cef-524a-45f7-b4ef-638f036b8e7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:48.556738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 302/624] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:48.558449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c9d30-6ae0-4211-9c07-8154f7ede860 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.558730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c9d30-6ae0-4211-9c07-8154f7ede860 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.559004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c9d30-6ae0-4211-9c07-8154f7ede860 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.561572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 303/625] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:48.566728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771425ad-2ce8-402e-8088-29a9f4e95043 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.567015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771425ad-2ce8-402e-8088-29a9f4e95043 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.567295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771425ad-2ce8-402e-8088-29a9f4e95043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.587335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-771425ad-2ce8-402e-8088-29a9f4e95043 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:48.588561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-771425ad-2ce8-402e-8088-29a9f4e95043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:48.590099 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b11ab2-e071-4fef-9107-e1e00222bccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:48.591140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b11ab2-e071-4fef-9107-e1e00222bccd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.591635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b11ab2-e071-4fef-9107-e1e00222bccd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.591915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b11ab2-e071-4fef-9107-e1e00222bccd None admin] PATH_INFO: `/v3/users/nova` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.599247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b11ab2-e071-4fef-9107-e1e00222bccd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:48.600722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b11ab2-e071-4fef-9107-e1e00222bccd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:48.614766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-92b11ab2-e071-4fef-9107-e1e00222bccd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 17:11:48.620923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 323/626] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Mar 10 17:11:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:48.621777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b11ab2-e071-4fef-9107-e1e00222bccd None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:48.667648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 304/627] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:48.669071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771425ad-2ce8-402e-8088-29a9f4e95043 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:48.751891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b11ab2-e071-4fef-9107-e1e00222bccd None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:48.787366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aac182-b8da-449d-bdde-2d2cb827f7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:48.788379 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac182-b8da-449d-bdde-2d2cb827f7df None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.788889 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac182-b8da-449d-bdde-2d2cb827f7df None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.789387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac182-b8da-449d-bdde-2d2cb827f7df None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.790404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aac182-b8da-449d-bdde-2d2cb827f7df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:48.790916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aac182-b8da-449d-bdde-2d2cb827f7df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:48.792536 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aac182-b8da-449d-bdde-2d2cb827f7df None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:48.793735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771425ad-2ce8-402e-8088-29a9f4e95043 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:48.806211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 324/628] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:48.807466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aac182-b8da-449d-bdde-2d2cb827f7df None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:48.844729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07f0a8-869b-40e9-8827-ffd7e7dc2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:48.845412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07f0a8-869b-40e9-8827-ffd7e7dc2e6a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.845706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07f0a8-869b-40e9-8827-ffd7e7dc2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.845977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07f0a8-869b-40e9-8827-ffd7e7dc2e6a None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.846859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07f0a8-869b-40e9-8827-ffd7e7dc2e6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:48.847168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07f0a8-869b-40e9-8827-ffd7e7dc2e6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:48.848695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07f0a8-869b-40e9-8827-ffd7e7dc2e6a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:48.872911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 305/629] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Mar 10 17:11:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:48.873555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07f0a8-869b-40e9-8827-ffd7e7dc2e6a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:48.928773 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aac182-b8da-449d-bdde-2d2cb827f7df None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:48.973890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c5797-f908-4937-b088-597fb33bcb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:48.975737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c5797-f908-4937-b088-597fb33bcb1d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:48.976296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c5797-f908-4937-b088-597fb33bcb1d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:48.977161 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c5797-f908-4937-b088-597fb33bcb1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:48.988322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07f0a8-869b-40e9-8827-ffd7e7dc2e6a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:48.991397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c5797-f908-4937-b088-597fb33bcb1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:49.000092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-5b8c5797-f908-4937-b088-597fb33bcb1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:49.002321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 325/630] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:49.003009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c5797-f908-4937-b088-597fb33bcb1d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.023669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450a2f-11b1-44b8-b578-7769165d8c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.024561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450a2f-11b1-44b8-b578-7769165d8c57 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.024838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450a2f-11b1-44b8-b578-7769165d8c57 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.025108 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450a2f-11b1-44b8-b578-7769165d8c57 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/35cc9fe9f62844a38f78d52435186f26/roles/f7e74696bb6d4f4e8571a49a6c5335c8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.040432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450a2f-11b1-44b8-b578-7769165d8c57 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=35cc9fe9f62844a38f78d52435186f26, role_id=f7e74696bb6d4f4e8571a49a6c5335c8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:49.041638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450a2f-11b1-44b8-b578-7769165d8c57 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:49.060001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 306/631] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:11:48 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/35cc9fe9f62844a38f78d52435186f26/roles/f7e74696bb6d4f4e8571a49a6c5335c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:11:49.061071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450a2f-11b1-44b8-b578-7769165d8c57 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.126274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c5797-f908-4937-b088-597fb33bcb1d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:49.166083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05dcdb-82c5-40fe-b18a-0c4334ed9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.167295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05dcdb-82c5-40fe-b18a-0c4334ed9f4c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.167803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05dcdb-82c5-40fe-b18a-0c4334ed9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.168289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05dcdb-82c5-40fe-b18a-0c4334ed9f4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.199685 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450a2f-11b1-44b8-b578-7769165d8c57 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:49.243818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05dcdb-82c5-40fe-b18a-0c4334ed9f4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:49.245621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05dcdb-82c5-40fe-b18a-0c4334ed9f4c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:49.245832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49de57-8bb8-4e8a-be23-4b526bd8af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.246537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49de57-8bb8-4e8a-be23-4b526bd8af3a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.246816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49de57-8bb8-4e8a-be23-4b526bd8af3a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.247089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49de57-8bb8-4e8a-be23-4b526bd8af3a None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.247835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49de57-8bb8-4e8a-be23-4b526bd8af3a None admin] RBAC: Adding query filter params (name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:49.248135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49de57-8bb8-4e8a-be23-4b526bd8af3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:49.249738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49de57-8bb8-4e8a-be23-4b526bd8af3a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:49.261218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 307/632] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:49.262919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46e802-85ca-4956-9b7a-9c80d0d6135b None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.263205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46e802-85ca-4956-9b7a-9c80d0d6135b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.263649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46e802-85ca-4956-9b7a-9c80d0d6135b None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.266234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 308/633] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:49.267125 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46e802-85ca-4956-9b7a-9c80d0d6135b None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.355507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 326/634] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:49.356593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbfe6a-940f-4b21-86fb-f55d0ef0e362 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.356938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbfe6a-940f-4b21-86fb-f55d0ef0e362 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.357215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbfe6a-940f-4b21-86fb-f55d0ef0e362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.374202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-6bcbfe6a-940f-4b21-86fb-f55d0ef0e362 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:49.374612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46e802-85ca-4956-9b7a-9c80d0d6135b None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:49.375378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6bcbfe6a-940f-4b21-86fb-f55d0ef0e362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:49.406765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb45422-edd2-472e-87b6-07c6229258a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.407568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb45422-edd2-472e-87b6-07c6229258a0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.407855 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb45422-edd2-472e-87b6-07c6229258a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.408128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb45422-edd2-472e-87b6-07c6229258a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.418512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb45422-edd2-472e-87b6-07c6229258a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:49.419962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb45422-edd2-472e-87b6-07c6229258a0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:49.437225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-3eb45422-edd2-472e-87b6-07c6229258a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:49.442869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 309/635] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:49.443004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 327/636] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:49.443004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbfe6a-940f-4b21-86fb-f55d0ef0e362 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.446567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7e337-35f4-4bcb-bf2b-5093c7f3a8d9 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.446850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7e337-35f4-4bcb-bf2b-5093c7f3a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.447123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7e337-35f4-4bcb-bf2b-5093c7f3a8d9 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.449182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 310/637] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:49.451406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7e337-35f4-4bcb-bf2b-5093c7f3a8d9 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.548845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbfe6a-940f-4b21-86fb-f55d0ef0e362 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:49.554432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7e337-35f4-4bcb-bf2b-5093c7f3a8d9 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:49.581941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc981ff0-6f25-4368-91f3-22e75d03babd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.582774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981ff0-6f25-4368-91f3-22e75d03babd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.583067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981ff0-6f25-4368-91f3-22e75d03babd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.583343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981ff0-6f25-4368-91f3-22e75d03babd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.587148 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60338c02-079b-4b21-a540-91b9a3b58434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.587797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338c02-079b-4b21-a540-91b9a3b58434 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.588078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338c02-079b-4b21-a540-91b9a3b58434 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.588350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338c02-079b-4b21-a540-91b9a3b58434 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.589055 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60338c02-079b-4b21-a540-91b9a3b58434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:49.589358 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60338c02-079b-4b21-a540-91b9a3b58434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:49.590791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60338c02-079b-4b21-a540-91b9a3b58434 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:49.593094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc981ff0-6f25-4368-91f3-22e75d03babd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:49.594556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc981ff0-6f25-4368-91f3-22e75d03babd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:49.606572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 311/638] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:49.606572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8a1c0-feb2-4329-bb77-d46894b25cb3 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.606572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8a1c0-feb2-4329-bb77-d46894b25cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.606572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8a1c0-feb2-4329-bb77-d46894b25cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.616600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-dc981ff0-6f25-4368-91f3-22e75d03babd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:49.617793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 328/639] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:49.618649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc981ff0-6f25-4368-91f3-22e75d03babd None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.626897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2df8a1c0-feb2-4329-bb77-d46894b25cb3 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:49.628063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2df8a1c0-feb2-4329-bb77-d46894b25cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:49.692301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 312/640] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:49.693250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8a1c0-feb2-4329-bb77-d46894b25cb3 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.732491 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc981ff0-6f25-4368-91f3-22e75d03babd None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:49.767286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ff12-7423-4085-9d05-7ab5f4f85774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.768093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ff12-7423-4085-9d05-7ab5f4f85774 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.768378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ff12-7423-4085-9d05-7ab5f4f85774 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.768652 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ff12-7423-4085-9d05-7ab5f4f85774 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.779295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155ff12-7423-4085-9d05-7ab5f4f85774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:49.786335 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-6155ff12-7423-4085-9d05-7ab5f4f85774 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:49.789403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 329/641] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:49.789403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ff12-7423-4085-9d05-7ab5f4f85774 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.791285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8a1c0-feb2-4329-bb77-d46894b25cb3 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:49.826806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c2f85-0b1e-4869-85af-ccebc429174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.827589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2f85-0b1e-4869-85af-ccebc429174a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.827871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2f85-0b1e-4869-85af-ccebc429174a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.828138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2f85-0b1e-4869-85af-ccebc429174a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.835743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c2f85-0b1e-4869-85af-ccebc429174a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:49.837197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c2f85-0b1e-4869-85af-ccebc429174a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:49.850790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-df1c2f85-0b1e-4869-85af-ccebc429174a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 10 17:11:49.856435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 313/642] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:49.856435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c2f85-0b1e-4869-85af-ccebc429174a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.893492 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ff12-7423-4085-9d05-7ab5f4f85774 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:49.927009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602133a-52b2-4418-a66f-974244747e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.928560 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602133a-52b2-4418-a66f-974244747e90 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.929337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602133a-52b2-4418-a66f-974244747e90 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.930306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602133a-52b2-4418-a66f-974244747e90 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:49.931230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602133a-52b2-4418-a66f-974244747e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:49.931755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602133a-52b2-4418-a66f-974244747e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:49.933312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602133a-52b2-4418-a66f-974244747e90 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:49.945601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 330/643] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:49.946464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602133a-52b2-4418-a66f-974244747e90 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:49.957720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c2f85-0b1e-4869-85af-ccebc429174a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:49.991894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662efd8-fb9e-481d-aac9-ff1683ac709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:49.992688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662efd8-fb9e-481d-aac9-ff1683ac709a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:49.992965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662efd8-fb9e-481d-aac9-ff1683ac709a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:49.993234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662efd8-fb9e-481d-aac9-ff1683ac709a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.002865 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662efd8-fb9e-481d-aac9-ff1683ac709a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:50.009708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-4662efd8-fb9e-481d-aac9-ff1683ac709a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:50.010899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 314/644] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:50.011654 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662efd8-fb9e-481d-aac9-ff1683ac709a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.049074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602133a-52b2-4418-a66f-974244747e90 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.082571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15df13-014b-463a-a296-0ba979ed3685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.083516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15df13-014b-463a-a296-0ba979ed3685 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.084018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15df13-014b-463a-a296-0ba979ed3685 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.084296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15df13-014b-463a-a296-0ba979ed3685 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.085042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15df13-014b-463a-a296-0ba979ed3685 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:50.085350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15df13-014b-463a-a296-0ba979ed3685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.086750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15df13-014b-463a-a296-0ba979ed3685 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.098914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 331/645] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:50.098914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15df13-014b-463a-a296-0ba979ed3685 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.112493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662efd8-fb9e-481d-aac9-ff1683ac709a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.146632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15f003-e8ce-4a95-830a-2a1a5b262d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.147300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f003-e8ce-4a95-830a-2a1a5b262d55 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.147587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f003-e8ce-4a95-830a-2a1a5b262d55 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.147867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f003-e8ce-4a95-830a-2a1a5b262d55 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.148694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15f003-e8ce-4a95-830a-2a1a5b262d55 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:50.149002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15f003-e8ce-4a95-830a-2a1a5b262d55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.150460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15f003-e8ce-4a95-830a-2a1a5b262d55 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.172189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 315/646] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:50.172189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15f003-e8ce-4a95-830a-2a1a5b262d55 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.194965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15df13-014b-463a-a296-0ba979ed3685 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.229673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43461efd-073b-45d8-aad4-b8dd97b0a023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.230510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461efd-073b-45d8-aad4-b8dd97b0a023 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.230794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461efd-073b-45d8-aad4-b8dd97b0a023 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.231062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461efd-073b-45d8-aad4-b8dd97b0a023 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.237691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43461efd-073b-45d8-aad4-b8dd97b0a023 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.239176 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43461efd-073b-45d8-aad4-b8dd97b0a023 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.253103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-43461efd-073b-45d8-aad4-b8dd97b0a023 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:50.254303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 332/647] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:50.255070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43461efd-073b-45d8-aad4-b8dd97b0a023 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.278647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15f003-e8ce-4a95-830a-2a1a5b262d55 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.320473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b668a04-ed84-4f4a-8d8d-77bba74c1ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.321147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b668a04-ed84-4f4a-8d8d-77bba74c1ebb None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.321430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b668a04-ed84-4f4a-8d8d-77bba74c1ebb None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.321708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b668a04-ed84-4f4a-8d8d-77bba74c1ebb None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.322490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b668a04-ed84-4f4a-8d8d-77bba74c1ebb None admin] RBAC: Adding query filter params (name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:50.322797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b668a04-ed84-4f4a-8d8d-77bba74c1ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.324248 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b668a04-ed84-4f4a-8d8d-77bba74c1ebb None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.336850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 316/648] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:50.336850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b668a04-ed84-4f4a-8d8d-77bba74c1ebb None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.362493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43461efd-073b-45d8-aad4-b8dd97b0a023 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.397244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef80f7-fa1d-4ef4-a5db-dcc1821778ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.398298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef80f7-fa1d-4ef4-a5db-dcc1821778ef None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.398738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef80f7-fa1d-4ef4-a5db-dcc1821778ef None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.399242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef80f7-fa1d-4ef4-a5db-dcc1821778ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.408635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef80f7-fa1d-4ef4-a5db-dcc1821778ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.410079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef80f7-fa1d-4ef4-a5db-dcc1821778ef None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.426581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-71ef80f7-fa1d-4ef4-a5db-dcc1821778ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:50.432603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 333/649] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:50.432603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef80f7-fa1d-4ef4-a5db-dcc1821778ef None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.440211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b668a04-ed84-4f4a-8d8d-77bba74c1ebb None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.472506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de09806-47de-40bf-bef9-9359e8debab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.473144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09806-47de-40bf-bef9-9359e8debab8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.473425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09806-47de-40bf-bef9-9359e8debab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.473698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09806-47de-40bf-bef9-9359e8debab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.537819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef80f7-fa1d-4ef4-a5db-dcc1821778ef None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.538970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de09806-47de-40bf-bef9-9359e8debab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.540587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de09806-47de-40bf-bef9-9359e8debab8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.574196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fec2da-5876-4420-96b6-a9a2e0d9d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.575072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fec2da-5876-4420-96b6-a9a2e0d9d150 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.575351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fec2da-5876-4420-96b6-a9a2e0d9d150 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.575640 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fec2da-5876-4420-96b6-a9a2e0d9d150 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.576404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fec2da-5876-4420-96b6-a9a2e0d9d150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:50.576940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fec2da-5876-4420-96b6-a9a2e0d9d150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.578146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fec2da-5876-4420-96b6-a9a2e0d9d150 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.594690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 334/650] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:50.594690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fec2da-5876-4420-96b6-a9a2e0d9d150 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.648894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 317/651] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:50.650140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de09806-47de-40bf-bef9-9359e8debab8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.693089 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fec2da-5876-4420-96b6-a9a2e0d9d150 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.726237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c822fb-899c-4f62-86f4-250d5ded6cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.727141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c822fb-899c-4f62-86f4-250d5ded6cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.727343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c822fb-899c-4f62-86f4-250d5ded6cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.727576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c822fb-899c-4f62-86f4-250d5ded6cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.737348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c822fb-899c-4f62-86f4-250d5ded6cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.738829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c822fb-899c-4f62-86f4-250d5ded6cd3 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.749370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de09806-47de-40bf-bef9-9359e8debab8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.757006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-e9c822fb-899c-4f62-86f4-250d5ded6cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:50.758520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 335/652] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:50.759516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c822fb-899c-4f62-86f4-250d5ded6cd3 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.783366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eae706-db85-4e2e-abb0-1a4bb4040724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.784051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eae706-db85-4e2e-abb0-1a4bb4040724 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.784324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eae706-db85-4e2e-abb0-1a4bb4040724 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.784841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eae706-db85-4e2e-abb0-1a4bb4040724 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.785341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eae706-db85-4e2e-abb0-1a4bb4040724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:50.785624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eae706-db85-4e2e-abb0-1a4bb4040724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.787562 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eae706-db85-4e2e-abb0-1a4bb4040724 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.804809 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 318/653] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:50.804809 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eae706-db85-4e2e-abb0-1a4bb4040724 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.863724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c822fb-899c-4f62-86f4-250d5ded6cd3 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.897259 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ca51e-72b4-4c87-97ad-f23911bf9e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.897930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ca51e-72b4-4c87-97ad-f23911bf9e90 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.898249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ca51e-72b4-4c87-97ad-f23911bf9e90 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.898532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ca51e-72b4-4c87-97ad-f23911bf9e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.899157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eae706-db85-4e2e-abb0-1a4bb4040724 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:50.899367 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ca51e-72b4-4c87-97ad-f23911bf9e90 None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=89a64b4a57114f77a231a31e16b3923e) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:50.899683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ca51e-72b4-4c87-97ad-f23911bf9e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.901124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ca51e-72b4-4c87-97ad-f23911bf9e90 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.914229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 336/654] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/role_assignments?user.id=89a64b4a57114f77a231a31e16b3923e&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:50.914229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ca51e-72b4-4c87-97ad-f23911bf9e90 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:50.945640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3848725-116b-457c-8250-07456438c555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:50.946489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3848725-116b-457c-8250-07456438c555 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:50.946781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3848725-116b-457c-8250-07456438c555 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:50.947066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3848725-116b-457c-8250-07456438c555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:50.963084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3848725-116b-457c-8250-07456438c555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:50.964570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3848725-116b-457c-8250-07456438c555 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:50.982014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-e3848725-116b-457c-8250-07456438c555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:50.987939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 319/655] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:50.988921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3848725-116b-457c-8250-07456438c555 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.036246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ca51e-72b4-4c87-97ad-f23911bf9e90 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.080554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d126-c2cd-40d5-8b7b-1ea9e9d813ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.081450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d126-c2cd-40d5-8b7b-1ea9e9d813ff None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.081737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d126-c2cd-40d5-8b7b-1ea9e9d813ff None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.082014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d126-c2cd-40d5-8b7b-1ea9e9d813ff None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.082984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d126-c2cd-40d5-8b7b-1ea9e9d813ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:51.083303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d126-c2cd-40d5-8b7b-1ea9e9d813ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:51.085667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d126-c2cd-40d5-8b7b-1ea9e9d813ff None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:51.102118 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3848725-116b-457c-8250-07456438c555 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.104428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 337/656] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:51.106189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d126-c2cd-40d5-8b7b-1ea9e9d813ff None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.143561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75715d-253f-4170-8e42-2fc69fae9bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.144518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75715d-253f-4170-8e42-2fc69fae9bfc None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.144901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75715d-253f-4170-8e42-2fc69fae9bfc None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.146211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75715d-253f-4170-8e42-2fc69fae9bfc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.157664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75715d-253f-4170-8e42-2fc69fae9bfc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:51.159229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75715d-253f-4170-8e42-2fc69fae9bfc None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:51.176341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-ff75715d-253f-4170-8e42-2fc69fae9bfc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 10 17:11:51.177576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 320/657] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:51.180908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75715d-253f-4170-8e42-2fc69fae9bfc None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.218687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d126-c2cd-40d5-8b7b-1ea9e9d813ff None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.265952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dfbf0-e376-431e-bb4c-aa1cb0396f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.266714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dfbf0-e376-431e-bb4c-aa1cb0396f01 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.267024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dfbf0-e376-431e-bb4c-aa1cb0396f01 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.267307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dfbf0-e376-431e-bb4c-aa1cb0396f01 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.268034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dfbf0-e376-431e-bb4c-aa1cb0396f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:51.268337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dfbf0-e376-431e-bb4c-aa1cb0396f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:51.269707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dfbf0-e376-431e-bb4c-aa1cb0396f01 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:51.282815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 338/658] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:51.283676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dfbf0-e376-431e-bb4c-aa1cb0396f01 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.314123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75715d-253f-4170-8e42-2fc69fae9bfc None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.348559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab0b29-1861-4110-82b0-6e151f410e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.349308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab0b29-1861-4110-82b0-6e151f410e44 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.350188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab0b29-1861-4110-82b0-6e151f410e44 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.350469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab0b29-1861-4110-82b0-6e151f410e44 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.358217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab0b29-1861-4110-82b0-6e151f410e44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:51.359806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab0b29-1861-4110-82b0-6e151f410e44 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:51.373741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-7cab0b29-1861-4110-82b0-6e151f410e44 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 10 17:11:51.375280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 321/659] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:51.376137 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab0b29-1861-4110-82b0-6e151f410e44 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.407790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dfbf0-e376-431e-bb4c-aa1cb0396f01 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.446599 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a1703-796a-459a-8f12-341da50c1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.447283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a1703-796a-459a-8f12-341da50c1745 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.447565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a1703-796a-459a-8f12-341da50c1745 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.447841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a1703-796a-459a-8f12-341da50c1745 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.448682 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a1703-796a-459a-8f12-341da50c1745 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:51.448991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a1703-796a-459a-8f12-341da50c1745 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:51.450439 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a1703-796a-459a-8f12-341da50c1745 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:51.471625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 339/660] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Mar 10 17:11:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:51.471625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a1703-796a-459a-8f12-341da50c1745 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.481485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab0b29-1861-4110-82b0-6e151f410e44 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.514393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17891fa-ff16-4c2f-b49d-06470f6f167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.515188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17891fa-ff16-4c2f-b49d-06470f6f167c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.515475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17891fa-ff16-4c2f-b49d-06470f6f167c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.515750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17891fa-ff16-4c2f-b49d-06470f6f167c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.522388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17891fa-ff16-4c2f-b49d-06470f6f167c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:51.523833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17891fa-ff16-4c2f-b49d-06470f6f167c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:51.537781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-f17891fa-ff16-4c2f-b49d-06470f6f167c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:51.543671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 322/661] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:51.543671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23419da6-b236-4303-a188-f0e585a10e16 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.543671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23419da6-b236-4303-a188-f0e585a10e16 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.543671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23419da6-b236-4303-a188-f0e585a10e16 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.543671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 323/662] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:51.543671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23419da6-b236-4303-a188-f0e585a10e16 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.572516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a1703-796a-459a-8f12-341da50c1745 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.607120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aecc77-4d1c-41a0-b97b-8f9c2f51b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.607733 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aecc77-4d1c-41a0-b97b-8f9c2f51b10b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.608026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aecc77-4d1c-41a0-b97b-8f9c2f51b10b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.608298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aecc77-4d1c-41a0-b97b-8f9c2f51b10b None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.609129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aecc77-4d1c-41a0-b97b-8f9c2f51b10b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:51.609437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aecc77-4d1c-41a0-b97b-8f9c2f51b10b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:51.610884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aecc77-4d1c-41a0-b97b-8f9c2f51b10b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:51.627794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 340/663] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Mar 10 17:11:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:51.628892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aecc77-4d1c-41a0-b97b-8f9c2f51b10b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.645948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23419da6-b236-4303-a188-f0e585a10e16 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.679960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a6456-2a36-43c8-9766-dc455901c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.680614 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a6456-2a36-43c8-9766-dc455901c333 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.680899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a6456-2a36-43c8-9766-dc455901c333 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.681177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a6456-2a36-43c8-9766-dc455901c333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.724891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aecc77-4d1c-41a0-b97b-8f9c2f51b10b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.747303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a6456-2a36-43c8-9766-dc455901c333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:51.749040 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a6456-2a36-43c8-9766-dc455901c333 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:51.759074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef5c50-ec2c-443d-a5ca-8a2da54413ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.759748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef5c50-ec2c-443d-a5ca-8a2da54413ec None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.760035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef5c50-ec2c-443d-a5ca-8a2da54413ec None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.760319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef5c50-ec2c-443d-a5ca-8a2da54413ec None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.761107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef5c50-ec2c-443d-a5ca-8a2da54413ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:51.761424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef5c50-ec2c-443d-a5ca-8a2da54413ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:51.762888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef5c50-ec2c-443d-a5ca-8a2da54413ec None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:51.775076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 341/664] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:51.776392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03533-cd18-436e-9fcc-a79f6dec1fa3 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.776686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03533-cd18-436e-9fcc-a79f6dec1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.776965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03533-cd18-436e-9fcc-a79f6dec1fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:51.793425 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fca03533-cd18-436e-9fcc-a79f6dec1fa3 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:51.794672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fca03533-cd18-436e-9fcc-a79f6dec1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:51.853947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 324/665] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:51.853947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a6456-2a36-43c8-9766-dc455901c333 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.869413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 342/666] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:51.874993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03533-cd18-436e-9fcc-a79f6dec1fa3 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:51.947600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a6456-2a36-43c8-9766-dc455901c333 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.976457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03533-cd18-436e-9fcc-a79f6dec1fa3 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:51.980115 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10189b71-5b2a-46f2-a007-d74459e4e9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:51.980773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10189b71-5b2a-46f2-a007-d74459e4e9e6 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:51.981059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10189b71-5b2a-46f2-a007-d74459e4e9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:51.981338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10189b71-5b2a-46f2-a007-d74459e4e9e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.010424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c3f3d-9ad0-48d5-9f64-a58704d6741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.011094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c3f3d-9ad0-48d5-9f64-a58704d6741b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.011382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c3f3d-9ad0-48d5-9f64-a58704d6741b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.011662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c3f3d-9ad0-48d5-9f64-a58704d6741b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.012555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c3f3d-9ad0-48d5-9f64-a58704d6741b None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=9f582002cd7141428072dacd218dbe86) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:52.012872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c3f3d-9ad0-48d5-9f64-a58704d6741b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.014377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c3f3d-9ad0-48d5-9f64-a58704d6741b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.020113 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 343/667] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:51 2022] GET /identity/v3/role_assignments?user.id=9f582002cd7141428072dacd218dbe86&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:52.031192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c3f3d-9ad0-48d5-9f64-a58704d6741b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.049950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10189b71-5b2a-46f2-a007-d74459e4e9e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.051485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10189b71-5b2a-46f2-a007-d74459e4e9e6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.169087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c3f3d-9ad0-48d5-9f64-a58704d6741b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:52.177236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 325/668] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:52.179169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10189b71-5b2a-46f2-a007-d74459e4e9e6 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.219041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed34bf6-f474-4bc9-8437-bd703e2afc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.220917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34bf6-f474-4bc9-8437-bd703e2afc99 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.220917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34bf6-f474-4bc9-8437-bd703e2afc99 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.220917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34bf6-f474-4bc9-8437-bd703e2afc99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.233406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed34bf6-f474-4bc9-8437-bd703e2afc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.234900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed34bf6-f474-4bc9-8437-bd703e2afc99 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.253124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-aed34bf6-f474-4bc9-8437-bd703e2afc99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:52.259462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 344/669] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:52.260406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed34bf6-f474-4bc9-8437-bd703e2afc99 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.301192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10189b71-5b2a-46f2-a007-d74459e4e9e6 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:52.347908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05ec2d-4d3d-4824-aed0-3d634e3aeb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.348715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05ec2d-4d3d-4824-aed0-3d634e3aeb23 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.349001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05ec2d-4d3d-4824-aed0-3d634e3aeb23 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.349283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05ec2d-4d3d-4824-aed0-3d634e3aeb23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.362360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05ec2d-4d3d-4824-aed0-3d634e3aeb23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:52.371484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-8e05ec2d-4d3d-4824-aed0-3d634e3aeb23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:11:52.373300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 326/670] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:52.374503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05ec2d-4d3d-4824-aed0-3d634e3aeb23 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.381787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed34bf6-f474-4bc9-8437-bd703e2afc99 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:52.425609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1bb4-cbb7-499b-b745-8f75354b1f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.426739 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1bb4-cbb7-499b-b745-8f75354b1f57 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.427353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1bb4-cbb7-499b-b745-8f75354b1f57 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.428231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1bb4-cbb7-499b-b745-8f75354b1f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.441963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da1bb4-cbb7-499b-b745-8f75354b1f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.444939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da1bb4-cbb7-499b-b745-8f75354b1f57 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.466452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-a1da1bb4-cbb7-499b-b745-8f75354b1f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:52.467685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 345/671] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:52.472563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1bb4-cbb7-499b-b745-8f75354b1f57 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.485950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05ec2d-4d3d-4824-aed0-3d634e3aeb23 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:52.520369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd7778-8055-4e5c-af74-406611f0aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.521034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd7778-8055-4e5c-af74-406611f0aa01 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.521357 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd7778-8055-4e5c-af74-406611f0aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.521636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd7778-8055-4e5c-af74-406611f0aa01 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.522402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd7778-8055-4e5c-af74-406611f0aa01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:52.522710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd7778-8055-4e5c-af74-406611f0aa01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.524090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd7778-8055-4e5c-af74-406611f0aa01 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.541058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 327/672] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:52.541058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd7778-8055-4e5c-af74-406611f0aa01 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.594149 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1bb4-cbb7-499b-b745-8f75354b1f57 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:52.628237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031e546-324b-43fe-90ab-86c390412192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.629135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031e546-324b-43fe-90ab-86c390412192 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.629563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031e546-324b-43fe-90ab-86c390412192 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.629982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031e546-324b-43fe-90ab-86c390412192 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.630937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031e546-324b-43fe-90ab-86c390412192 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:52.631386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031e546-324b-43fe-90ab-86c390412192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.632923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031e546-324b-43fe-90ab-86c390412192 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.641623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 346/673] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:52.642782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031e546-324b-43fe-90ab-86c390412192 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.643571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd7778-8055-4e5c-af74-406611f0aa01 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:52.679556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd13eec-aa25-49ff-986a-01a357aaeb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.679556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13eec-aa25-49ff-986a-01a357aaeb51 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.679882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13eec-aa25-49ff-986a-01a357aaeb51 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.680292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13eec-aa25-49ff-986a-01a357aaeb51 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.681086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd13eec-aa25-49ff-986a-01a357aaeb51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:52.681475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd13eec-aa25-49ff-986a-01a357aaeb51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.682950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd13eec-aa25-49ff-986a-01a357aaeb51 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.699383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 328/674] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:52.699383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd13eec-aa25-49ff-986a-01a357aaeb51 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.750532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031e546-324b-43fe-90ab-86c390412192 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:52.784567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f224e-3e4a-4e25-84fa-93032122af19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.785604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f224e-3e4a-4e25-84fa-93032122af19 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.785993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f224e-3e4a-4e25-84fa-93032122af19 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.786418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f224e-3e4a-4e25-84fa-93032122af19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.793419 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f224e-3e4a-4e25-84fa-93032122af19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.795115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f224e-3e4a-4e25-84fa-93032122af19 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.804603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd13eec-aa25-49ff-986a-01a357aaeb51 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:52.810271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-a66f224e-3e4a-4e25-84fa-93032122af19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:52.816117 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 347/675] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:52.816117 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f224e-3e4a-4e25-84fa-93032122af19 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.844700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91773-1675-4b16-9fc3-4d5600d33a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.845851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91773-1675-4b16-9fc3-4d5600d33a20 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.846387 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91773-1675-4b16-9fc3-4d5600d33a20 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.846875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91773-1675-4b16-9fc3-4d5600d33a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.857889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf91773-1675-4b16-9fc3-4d5600d33a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.859684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf91773-1675-4b16-9fc3-4d5600d33a20 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.877577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-edf91773-1675-4b16-9fc3-4d5600d33a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:52.879490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 329/676] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:52.880656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91773-1675-4b16-9fc3-4d5600d33a20 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.916364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f224e-3e4a-4e25-84fa-93032122af19 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:52.952750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd45d9-e61d-4107-94d1-bcb10ce3d24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:52.954180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd45d9-e61d-4107-94d1-bcb10ce3d24b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:52.954180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd45d9-e61d-4107-94d1-bcb10ce3d24b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:52.954180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd45d9-e61d-4107-94d1-bcb10ce3d24b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:52.961512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd45d9-e61d-4107-94d1-bcb10ce3d24b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:52.963174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd45d9-e61d-4107-94d1-bcb10ce3d24b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:52.977169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-19fd45d9-e61d-4107-94d1-bcb10ce3d24b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:52.982905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 348/677] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:52.982905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd45d9-e61d-4107-94d1-bcb10ce3d24b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:52.992871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91773-1675-4b16-9fc3-4d5600d33a20 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:53.027334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf8e4e-7d5e-4217-bd26-29203e613472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:53.028301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf8e4e-7d5e-4217-bd26-29203e613472 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.028791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf8e4e-7d5e-4217-bd26-29203e613472 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.029261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf8e4e-7d5e-4217-bd26-29203e613472 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.030323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf8e4e-7d5e-4217-bd26-29203e613472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:53.030844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf8e4e-7d5e-4217-bd26-29203e613472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:53.032476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf8e4e-7d5e-4217-bd26-29203e613472 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:53.050676 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 330/678] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:53.051870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf8e4e-7d5e-4217-bd26-29203e613472 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:53.087225 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd45d9-e61d-4107-94d1-bcb10ce3d24b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:53.122190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c6da7-ca8f-4966-aad2-c30a4f1a9b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:53.122880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c6da7-ca8f-4966-aad2-c30a4f1a9b66 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.123168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c6da7-ca8f-4966-aad2-c30a4f1a9b66 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.123450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c6da7-ca8f-4966-aad2-c30a4f1a9b66 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.124188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c6da7-ca8f-4966-aad2-c30a4f1a9b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:53.124507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c6da7-ca8f-4966-aad2-c30a4f1a9b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:53.126043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c6da7-ca8f-4966-aad2-c30a4f1a9b66 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:53.143068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 349/679] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:53.144019 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c6da7-ca8f-4966-aad2-c30a4f1a9b66 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:53.161276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf8e4e-7d5e-4217-bd26-29203e613472 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:53.199814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a6894-ddb1-4db0-87d8-950ce1abd05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:53.201666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a6894-ddb1-4db0-87d8-950ce1abd05e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.202442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a6894-ddb1-4db0-87d8-950ce1abd05e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.202976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a6894-ddb1-4db0-87d8-950ce1abd05e None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.204470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a6894-ddb1-4db0-87d8-950ce1abd05e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:53.205246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a6894-ddb1-4db0-87d8-950ce1abd05e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:53.207420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a6894-ddb1-4db0-87d8-950ce1abd05e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:53.220693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 331/680] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:53.225771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a6894-ddb1-4db0-87d8-950ce1abd05e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:53.257523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c6da7-ca8f-4966-aad2-c30a4f1a9b66 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:53.294075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1fe83-911a-4340-83fe-a5ce5b93c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:53.294839 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1fe83-911a-4340-83fe-a5ce5b93c264 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.295208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1fe83-911a-4340-83fe-a5ce5b93c264 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.295406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1fe83-911a-4340-83fe-a5ce5b93c264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.296236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1fe83-911a-4340-83fe-a5ce5b93c264 None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=701c0e43cc30442582456f4f7153333a) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:53.296817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1fe83-911a-4340-83fe-a5ce5b93c264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:53.298418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1fe83-911a-4340-83fe-a5ce5b93c264 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:53.306608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 350/681] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:53 2022] GET /identity/v3/role_assignments?user.id=701c0e43cc30442582456f4f7153333a&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:53.306608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1fe83-911a-4340-83fe-a5ce5b93c264 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:53.383363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a6894-ddb1-4db0-87d8-950ce1abd05e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:53.413397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1fe83-911a-4340-83fe-a5ce5b93c264 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:53.442458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66609d66-ae27-49c4-a67f-2bed73ec5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:53.444102 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609d66-ae27-49c4-a67f-2bed73ec5c2c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.444411 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609d66-ae27-49c4-a67f-2bed73ec5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.444692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609d66-ae27-49c4-a67f-2bed73ec5c2c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.454423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609d66-ae27-49c4-a67f-2bed73ec5c2c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:53.455911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609d66-ae27-49c4-a67f-2bed73ec5c2c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:53.474127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-66609d66-ae27-49c4-a67f-2bed73ec5c2c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 17:11:53.475117 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025daf4-63e7-45a3-a532-0d75b72b5d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:53.475992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025daf4-63e7-45a3-a532-0d75b72b5d8a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.476275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 332/682] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:53.476638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025daf4-63e7-45a3-a532-0d75b72b5d8a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.481510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025daf4-63e7-45a3-a532-0d75b72b5d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.481671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144819b7-c965-4bca-8312-b1e41a007b05 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.481671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144819b7-c965-4bca-8312-b1e41a007b05 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.481671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144819b7-c965-4bca-8312-b1e41a007b05 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.481671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 333/683] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:53.483142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025daf4-63e7-45a3-a532-0d75b72b5d8a None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=ad9a11df2d3d4dc292a5115de69bb288) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:53.483693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025daf4-63e7-45a3-a532-0d75b72b5d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:53.484974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144819b7-c965-4bca-8312-b1e41a007b05 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:53.485635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025daf4-63e7-45a3-a532-0d75b72b5d8a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:53.492635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 351/684] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:53 2022] GET /identity/v3/role_assignments?user.id=ad9a11df2d3d4dc292a5115de69bb288&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:53.494318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318305f-4bf5-42fb-9a9a-282412c41a7f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.494799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318305f-4bf5-42fb-9a9a-282412c41a7f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.495078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318305f-4bf5-42fb-9a9a-282412c41a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.512407 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4318305f-4bf5-42fb-9a9a-282412c41a7f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:53.513626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4318305f-4bf5-42fb-9a9a-282412c41a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:53.595590 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 352/685] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:53.632705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318305f-4bf5-42fb-9a9a-282412c41a7f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:53.655599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144819b7-c965-4bca-8312-b1e41a007b05 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:53.703887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5a96-00c2-4422-b1c2-cc341fc25afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:53.704766 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5a96-00c2-4422-b1c2-cc341fc25afa None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.705324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5a96-00c2-4422-b1c2-cc341fc25afa None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.705615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5a96-00c2-4422-b1c2-cc341fc25afa None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.706498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb5a96-00c2-4422-b1c2-cc341fc25afa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:53.706813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb5a96-00c2-4422-b1c2-cc341fc25afa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:53.709521 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb5a96-00c2-4422-b1c2-cc341fc25afa None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:53.735752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 334/686] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Mar 10 17:11:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:53.741231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5a96-00c2-4422-b1c2-cc341fc25afa None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:53.763679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318305f-4bf5-42fb-9a9a-282412c41a7f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:53.809665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967d369-dc05-417c-b133-374d868cf40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:53.811022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967d369-dc05-417c-b133-374d868cf40c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.811326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967d369-dc05-417c-b133-374d868cf40c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.811611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967d369-dc05-417c-b133-374d868cf40c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.825212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967d369-dc05-417c-b133-374d868cf40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:53.834773 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-4967d369-dc05-417c-b133-374d868cf40c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:11:53.836692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 353/687] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:53.842576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967d369-dc05-417c-b133-374d868cf40c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:53.875241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5a96-00c2-4422-b1c2-cc341fc25afa None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:53.917612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dd81b-ff97-414c-a722-78da2081e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:53.918587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dd81b-ff97-414c-a722-78da2081e482 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:53.918877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dd81b-ff97-414c-a722-78da2081e482 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:53.919157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dd81b-ff97-414c-a722-78da2081e482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:53.967932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967d369-dc05-417c-b133-374d868cf40c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:54.008250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dd81b-ff97-414c-a722-78da2081e482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:54.009863 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dd81b-ff97-414c-a722-78da2081e482 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:54.012894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4eced-1484-4889-8222-9dc2e4d95238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:54.014720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4eced-1484-4889-8222-9dc2e4d95238 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.015219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4eced-1484-4889-8222-9dc2e4d95238 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.015702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4eced-1484-4889-8222-9dc2e4d95238 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.016656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4eced-1484-4889-8222-9dc2e4d95238 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:54.017165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4eced-1484-4889-8222-9dc2e4d95238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:54.018784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4eced-1484-4889-8222-9dc2e4d95238 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:54.030306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 354/688] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:54.037289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4eced-1484-4889-8222-9dc2e4d95238 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:54.132499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 335/689] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:54.137615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dd81b-ff97-414c-a722-78da2081e482 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:54.212016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4eced-1484-4889-8222-9dc2e4d95238 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:54.248996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245029f1-b7d1-4b23-975f-632259456e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:54.249807 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245029f1-b7d1-4b23-975f-632259456e5b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.250093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245029f1-b7d1-4b23-975f-632259456e5b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.250401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245029f1-b7d1-4b23-975f-632259456e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.262292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245029f1-b7d1-4b23-975f-632259456e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:54.263793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245029f1-b7d1-4b23-975f-632259456e5b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:54.282386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-245029f1-b7d1-4b23-975f-632259456e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:54.284269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 355/690] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:54.290069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245029f1-b7d1-4b23-975f-632259456e5b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:54.405155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245029f1-b7d1-4b23-975f-632259456e5b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:54.424230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dd81b-ff97-414c-a722-78da2081e482 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:54.446573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9f9ac-c1f9-4a08-8285-1064cee36283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:54.447243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9f9ac-c1f9-4a08-8285-1064cee36283 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.447534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9f9ac-c1f9-4a08-8285-1064cee36283 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.447813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9f9ac-c1f9-4a08-8285-1064cee36283 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.448537 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9f9ac-c1f9-4a08-8285-1064cee36283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:54.448846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9f9ac-c1f9-4a08-8285-1064cee36283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:54.450257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9f9ac-c1f9-4a08-8285-1064cee36283 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:54.478046 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 356/691] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:54.483694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9f9ac-c1f9-4a08-8285-1064cee36283 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:54.492439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ada9f-0c87-4b5b-917c-f17e9db3f389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:54.495044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ada9f-0c87-4b5b-917c-f17e9db3f389 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.498481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ada9f-0c87-4b5b-917c-f17e9db3f389 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.499115 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ada9f-0c87-4b5b-917c-f17e9db3f389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.519046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ada9f-0c87-4b5b-917c-f17e9db3f389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:54.520837 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ada9f-0c87-4b5b-917c-f17e9db3f389 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:54.552770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-cd1ada9f-0c87-4b5b-917c-f17e9db3f389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:54.553692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 336/692] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:54.555123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcd4d-40e2-4751-a360-59429889a570 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.555466 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcd4d-40e2-4751-a360-59429889a570 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.555756 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcd4d-40e2-4751-a360-59429889a570 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.561446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 337/693] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:54.562516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bcd4d-40e2-4751-a360-59429889a570 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:54.620479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9f9ac-c1f9-4a08-8285-1064cee36283 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:54.660844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff425e7-8a4d-4439-83c9-77a6bc83e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:54.663004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff425e7-8a4d-4439-83c9-77a6bc83e31a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.663511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff425e7-8a4d-4439-83c9-77a6bc83e31a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.663991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff425e7-8a4d-4439-83c9-77a6bc83e31a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.673830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff425e7-8a4d-4439-83c9-77a6bc83e31a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:54.675591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff425e7-8a4d-4439-83c9-77a6bc83e31a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:54.677477 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bcd4d-40e2-4751-a360-59429889a570 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:54.690356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-aff425e7-8a4d-4439-83c9-77a6bc83e31a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 17:11:54.697159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 357/694] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Mar 10 17:11:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:54.698898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a017b-30ee-4192-81c4-08f9153f919a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.699419 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a017b-30ee-4192-81c4-08f9153f919a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.699907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a017b-30ee-4192-81c4-08f9153f919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.718053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0d4a017b-30ee-4192-81c4-08f9153f919a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:54.718448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fde86b-4eb5-4664-9a57-d527acf4eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:54.719120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fde86b-4eb5-4664-9a57-d527acf4eff6 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.719460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fde86b-4eb5-4664-9a57-d527acf4eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.719745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fde86b-4eb5-4664-9a57-d527acf4eff6 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.720481 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0d4a017b-30ee-4192-81c4-08f9153f919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:54.720588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fde86b-4eb5-4664-9a57-d527acf4eff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:54.720811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fde86b-4eb5-4664-9a57-d527acf4eff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:54.722280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fde86b-4eb5-4664-9a57-d527acf4eff6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:54.734842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 338/695] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:54.735696 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fde86b-4eb5-4664-9a57-d527acf4eff6 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:54.788680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 358/696] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:54.789844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a017b-30ee-4192-81c4-08f9153f919a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:54.861609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fde86b-4eb5-4664-9a57-d527acf4eff6 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:54.892007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a017b-30ee-4192-81c4-08f9153f919a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:54.897007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be3f93-4764-4f8e-949c-a0c7f3cafeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:54.897684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3f93-4764-4f8e-949c-a0c7f3cafeb8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.897970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3f93-4764-4f8e-949c-a0c7f3cafeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.898298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3f93-4764-4f8e-949c-a0c7f3cafeb8 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.899134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be3f93-4764-4f8e-949c-a0c7f3cafeb8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:54.899444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be3f93-4764-4f8e-949c-a0c7f3cafeb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:54.900896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be3f93-4764-4f8e-949c-a0c7f3cafeb8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:54.918672 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 339/697] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Mar 10 17:11:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:54.923547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be3f93-4764-4f8e-949c-a0c7f3cafeb8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:54.935242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d5a9b-fe72-4260-aaaa-0d039d9ec378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:54.936363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d5a9b-fe72-4260-aaaa-0d039d9ec378 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:54.936854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d5a9b-fe72-4260-aaaa-0d039d9ec378 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:54.937350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d5a9b-fe72-4260-aaaa-0d039d9ec378 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:54.944646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d5a9b-fe72-4260-aaaa-0d039d9ec378 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:54.946387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d5a9b-fe72-4260-aaaa-0d039d9ec378 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:54.961313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-150d5a9b-fe72-4260-aaaa-0d039d9ec378 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:54.963271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 359/698] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:54.964343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d5a9b-fe72-4260-aaaa-0d039d9ec378 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:55.029046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be3f93-4764-4f8e-949c-a0c7f3cafeb8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:55.063961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7ebb0-a9e6-4f8e-84e6-55d7217f1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:55.064700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7ebb0-a9e6-4f8e-84e6-55d7217f1ccf None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:55.064985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7ebb0-a9e6-4f8e-84e6-55d7217f1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:55.065276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7ebb0-a9e6-4f8e-84e6-55d7217f1ccf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:55.065919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7ebb0-a9e6-4f8e-84e6-55d7217f1ccf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:55.067345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7ebb0-a9e6-4f8e-84e6-55d7217f1ccf None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:55.069786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d5a9b-fe72-4260-aaaa-0d039d9ec378 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:55.080851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-76c7ebb0-a9e6-4f8e-84e6-55d7217f1ccf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 10 17:11:55.087732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 340/699] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Mar 10 17:11:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:55.088726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7ebb0-a9e6-4f8e-84e6-55d7217f1ccf None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:55.107790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85db0e2-9d02-458d-918a-e03417c5f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:55.108822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85db0e2-9d02-458d-918a-e03417c5f238 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:55.109318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85db0e2-9d02-458d-918a-e03417c5f238 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:55.109822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85db0e2-9d02-458d-918a-e03417c5f238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:55.183369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85db0e2-9d02-458d-918a-e03417c5f238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:55.185217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85db0e2-9d02-458d-918a-e03417c5f238 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:55.197421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7ebb0-a9e6-4f8e-84e6-55d7217f1ccf None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:55.231165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e8e7-013f-46b3-9702-0d18959de432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:55.231834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e8e7-013f-46b3-9702-0d18959de432 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:55.232122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e8e7-013f-46b3-9702-0d18959de432 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:55.232402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e8e7-013f-46b3-9702-0d18959de432 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:55.233189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69e8e7-013f-46b3-9702-0d18959de432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:55.233500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69e8e7-013f-46b3-9702-0d18959de432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:55.234977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69e8e7-013f-46b3-9702-0d18959de432 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:55.248012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 341/700] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:55.248921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e8e7-013f-46b3-9702-0d18959de432 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:55.293311 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 360/701] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:11:55.294893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85db0e2-9d02-458d-918a-e03417c5f238 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:55.354029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e8e7-013f-46b3-9702-0d18959de432 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:55.387663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219a70c-bf44-4ee4-99c0-54d3e62769e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:55.388331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219a70c-bf44-4ee4-99c0-54d3e62769e4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:55.388617 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219a70c-bf44-4ee4-99c0-54d3e62769e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:55.388896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219a70c-bf44-4ee4-99c0-54d3e62769e4 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:55.389599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219a70c-bf44-4ee4-99c0-54d3e62769e4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:55.389906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219a70c-bf44-4ee4-99c0-54d3e62769e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:55.391312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219a70c-bf44-4ee4-99c0-54d3e62769e4 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:55.395101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85db0e2-9d02-458d-918a-e03417c5f238 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:55.400324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 342/702] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Mar 10 17:11:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:55.401191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219a70c-bf44-4ee4-99c0-54d3e62769e4 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:55.430435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761614c-7acb-49a7-85a0-9c0ecfebaa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:55.431337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761614c-7acb-49a7-85a0-9c0ecfebaa67 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:55.431775 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761614c-7acb-49a7-85a0-9c0ecfebaa67 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:55.432228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761614c-7acb-49a7-85a0-9c0ecfebaa67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:55.433200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761614c-7acb-49a7-85a0-9c0ecfebaa67 None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=35cc9fe9f62844a38f78d52435186f26) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:55.433662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761614c-7acb-49a7-85a0-9c0ecfebaa67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:55.435290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761614c-7acb-49a7-85a0-9c0ecfebaa67 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:55.441631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 361/703] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:55 2022] GET /identity/v3/role_assignments?user.id=35cc9fe9f62844a38f78d52435186f26&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:55.442783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761614c-7acb-49a7-85a0-9c0ecfebaa67 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:55.503756 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219a70c-bf44-4ee4-99c0-54d3e62769e4 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:55.568310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97744193-55eb-402b-b65d-d4abe7c1957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:55.569133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97744193-55eb-402b-b65d-d4abe7c1957e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:55.569419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97744193-55eb-402b-b65d-d4abe7c1957e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:55.569694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97744193-55eb-402b-b65d-d4abe7c1957e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:55.590576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97744193-55eb-402b-b65d-d4abe7c1957e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:55.592065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97744193-55eb-402b-b65d-d4abe7c1957e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:55.612149 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761614c-7acb-49a7-85a0-9c0ecfebaa67 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:55.631329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-97744193-55eb-402b-b65d-d4abe7c1957e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:55.632956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 343/704] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:55.638273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97744193-55eb-402b-b65d-d4abe7c1957e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:55.656442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba629e-c32d-4d31-a4d5-7ed97e28c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:55.657135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba629e-c32d-4d31-a4d5-7ed97e28c937 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:55.657423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba629e-c32d-4d31-a4d5-7ed97e28c937 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:55.657703 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba629e-c32d-4d31-a4d5-7ed97e28c937 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:55.658472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba629e-c32d-4d31-a4d5-7ed97e28c937 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:55.658785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba629e-c32d-4d31-a4d5-7ed97e28c937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:55.660183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba629e-c32d-4d31-a4d5-7ed97e28c937 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:55.674831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 362/705] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Mar 10 17:11:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:55.787246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97744193-55eb-402b-b65d-d4abe7c1957e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:55.837464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c36900-c030-4000-9721-75210fa81943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:55.838171 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c36900-c030-4000-9721-75210fa81943 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:55.838463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c36900-c030-4000-9721-75210fa81943 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:55.838741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c36900-c030-4000-9721-75210fa81943 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:55.839480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c36900-c030-4000-9721-75210fa81943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:55.839787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c36900-c030-4000-9721-75210fa81943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:55.841226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c36900-c030-4000-9721-75210fa81943 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:55.856102 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 344/706] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:55.861809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba629e-c32d-4d31-a4d5-7ed97e28c937 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:55.967141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba629e-c32d-4d31-a4d5-7ed97e28c937 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:56.031614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e08adb-1482-4a16-b988-a7e844488552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:56.032432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e08adb-1482-4a16-b988-a7e844488552 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.032714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e08adb-1482-4a16-b988-a7e844488552 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.033079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e08adb-1482-4a16-b988-a7e844488552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.045151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e08adb-1482-4a16-b988-a7e844488552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:56.046872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e08adb-1482-4a16-b988-a7e844488552 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:56.064164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-06e08adb-1482-4a16-b988-a7e844488552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:11:56.065691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 363/707] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:56.071846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c36900-c030-4000-9721-75210fa81943 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:56.112613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e733fb-4de5-44e2-ac8d-dc2218aceb7a None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.112915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e733fb-4de5-44e2-ac8d-dc2218aceb7a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.113173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e733fb-4de5-44e2-ac8d-dc2218aceb7a None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.114987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 364/708] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:56.127516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d71178-962d-462f-88f8-b69757617ad5 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.127810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d71178-962d-462f-88f8-b69757617ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.128229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d71178-962d-462f-88f8-b69757617ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.155273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-34d71178-962d-462f-88f8-b69757617ad5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:56.156463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-34d71178-962d-462f-88f8-b69757617ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:56.236681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c36900-c030-4000-9721-75210fa81943 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:56.280619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 365/709] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:56.288189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcd79a-a282-4b6d-9e3a-ead08f44e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:56.288848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcd79a-a282-4b6d-9e3a-ead08f44e100 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.289129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcd79a-a282-4b6d-9e3a-ead08f44e100 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.289401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcd79a-a282-4b6d-9e3a-ead08f44e100 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.290210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcd79a-a282-4b6d-9e3a-ead08f44e100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:56.290533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcd79a-a282-4b6d-9e3a-ead08f44e100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:56.294789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcd79a-a282-4b6d-9e3a-ead08f44e100 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:56.312723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 345/710] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:56.317675 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d71178-962d-462f-88f8-b69757617ad5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:56.319196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcd79a-a282-4b6d-9e3a-ead08f44e100 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:56.448500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcd79a-a282-4b6d-9e3a-ead08f44e100 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:56.451568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d71178-962d-462f-88f8-b69757617ad5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:56.485370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc2705-a520-45e3-8c8f-af32371aba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:56.486050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc2705-a520-45e3-8c8f-af32371aba2f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.486381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc2705-a520-45e3-8c8f-af32371aba2f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.486657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc2705-a520-45e3-8c8f-af32371aba2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.487530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc2705-a520-45e3-8c8f-af32371aba2f None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=89a64b4a57114f77a231a31e16b3923e) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:56.487785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc2705-a520-45e3-8c8f-af32371aba2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:56.489202 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc2705-a520-45e3-8c8f-af32371aba2f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:56.492694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667fafc-9dd4-47cb-ba04-13b773e1ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:56.493796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667fafc-9dd4-47cb-ba04-13b773e1ca48 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.494085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667fafc-9dd4-47cb-ba04-13b773e1ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.494407 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667fafc-9dd4-47cb-ba04-13b773e1ca48 None admin] PATH_INFO: `/v3/services/network` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.494903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 346/711] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:11:56 2022] GET /identity/v3/role_assignments?user.id=89a64b4a57114f77a231a31e16b3923e&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:56.495063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667fafc-9dd4-47cb-ba04-13b773e1ca48 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:56.496106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ab09-8ec5-4271-93d2-65f3e7fb6544 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.496391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ab09-8ec5-4271-93d2-65f3e7fb6544 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.496488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667fafc-9dd4-47cb-ba04-13b773e1ca48 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:56.496659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ab09-8ec5-4271-93d2-65f3e7fb6544 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.498820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 347/712] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:56.504227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c681a7d-68d1-40b3-91b5-10dad35dbf67 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.504849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c681a7d-68d1-40b3-91b5-10dad35dbf67 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.504849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c681a7d-68d1-40b3-91b5-10dad35dbf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.522932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9c681a7d-68d1-40b3-91b5-10dad35dbf67 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:56.524147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9c681a7d-68d1-40b3-91b5-10dad35dbf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:56.538398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-a667fafc-9dd4-47cb-ba04-13b773e1ca48 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 10 17:11:56.539752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 366/713] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:11:56 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:56.547097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667fafc-9dd4-47cb-ba04-13b773e1ca48 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:56.622608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 348/714] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:56.661533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c681a7d-68d1-40b3-91b5-10dad35dbf67 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:56.719768 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667fafc-9dd4-47cb-ba04-13b773e1ca48 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:56.768920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a3555-2e54-4fc5-9e29-28e69e18d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:56.769527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a3555-2e54-4fc5-9e29-28e69e18d180 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.769817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a3555-2e54-4fc5-9e29-28e69e18d180 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.770098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a3555-2e54-4fc5-9e29-28e69e18d180 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.770840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a3555-2e54-4fc5-9e29-28e69e18d180 None admin] RBAC: Adding query filter params (name=network) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:56.771704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a3555-2e54-4fc5-9e29-28e69e18d180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:56.773101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a3555-2e54-4fc5-9e29-28e69e18d180 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:56.778017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 367/715] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:11:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:56.786561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a3555-2e54-4fc5-9e29-28e69e18d180 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:56.802785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c681a7d-68d1-40b3-91b5-10dad35dbf67 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:56.845635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caab864-3468-433c-b328-43a5efa3bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:56.846472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caab864-3468-433c-b328-43a5efa3bc35 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.846757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caab864-3468-433c-b328-43a5efa3bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.847035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caab864-3468-433c-b328-43a5efa3bc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.863097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caab864-3468-433c-b328-43a5efa3bc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:56.864571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caab864-3468-433c-b328-43a5efa3bc35 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:56.888221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a3555-2e54-4fc5-9e29-28e69e18d180 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:56.897668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-3caab864-3468-433c-b328-43a5efa3bc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:56.907526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 349/716] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:56.913307 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caab864-3468-433c-b328-43a5efa3bc35 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:56.936171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986cffc-9eb5-4b27-8997-604ec3686c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:56.937188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986cffc-9eb5-4b27-8997-604ec3686c0d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:56.937818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986cffc-9eb5-4b27-8997-604ec3686c0d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:56.938334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986cffc-9eb5-4b27-8997-604ec3686c0d None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:56.939278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986cffc-9eb5-4b27-8997-604ec3686c0d None admin] RBAC: Adding query filter params (type=network) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:56.939768 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986cffc-9eb5-4b27-8997-604ec3686c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:56.941319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986cffc-9eb5-4b27-8997-604ec3686c0d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:56.952162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 368/717] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:11:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:57.044525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caab864-3468-433c-b328-43a5efa3bc35 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:57.095329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6c24-4be6-4caa-8105-30b7cf508d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:57.096313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6c24-4be6-4caa-8105-30b7cf508d1d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:57.096776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6c24-4be6-4caa-8105-30b7cf508d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:57.097265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6c24-4be6-4caa-8105-30b7cf508d1d None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:57.098201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6c24-4be6-4caa-8105-30b7cf508d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:57.098688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6c24-4be6-4caa-8105-30b7cf508d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:57.100786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6c24-4be6-4caa-8105-30b7cf508d1d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:57.117526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 350/718] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:57.122738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986cffc-9eb5-4b27-8997-604ec3686c0d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:57.236483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986cffc-9eb5-4b27-8997-604ec3686c0d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:57.276661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74febf6f-71c7-4aee-a893-b95cc60f1800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:57.277684 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74febf6f-71c7-4aee-a893-b95cc60f1800 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:57.278210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74febf6f-71c7-4aee-a893-b95cc60f1800 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:57.278694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74febf6f-71c7-4aee-a893-b95cc60f1800 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:57.279601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74febf6f-71c7-4aee-a893-b95cc60f1800 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:57.281246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74febf6f-71c7-4aee-a893-b95cc60f1800 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:57.309676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 369/719] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:11:57 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:11:58.429081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c4c75-ca8f-422a-b962-6a2594f15444 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:58.430089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c4c75-ca8f-422a-b962-6a2594f15444 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:58.430629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c4c75-ca8f-422a-b962-6a2594f15444 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:58.432828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 351/720] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:58.444239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126d11b-66b7-4f19-abfb-99b46cf90c6a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:58.445147 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126d11b-66b7-4f19-abfb-99b46cf90c6a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:58.445630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126d11b-66b7-4f19-abfb-99b46cf90c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:58.468112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8126d11b-66b7-4f19-abfb-99b46cf90c6a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:58.469615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8126d11b-66b7-4f19-abfb-99b46cf90c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:58.552809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 370/721] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:58.583024 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c4c75-ca8f-422a-b962-6a2594f15444 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:58.623710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef49319-b6e7-451b-ab86-ca16c6666d48 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:58.624330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef49319-b6e7-451b-ab86-ca16c6666d48 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:58.624814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef49319-b6e7-451b-ab86-ca16c6666d48 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:58.627065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 371/722] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:58.633645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b083d-4ef0-47b0-97d0-e03915538f80 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:58.634242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b083d-4ef0-47b0-97d0-e03915538f80 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:58.634729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b083d-4ef0-47b0-97d0-e03915538f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:58.665515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-1b5b083d-4ef0-47b0-97d0-e03915538f80 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:58.667077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1b5b083d-4ef0-47b0-97d0-e03915538f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:58.726096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c4c75-ca8f-422a-b962-6a2594f15444 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:58.762987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 372/723] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:11:58.780355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3d717-2031-4ece-a734-de69ea9f39c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:58.781038 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d717-2031-4ece-a734-de69ea9f39c0 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:58.781321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d717-2031-4ece-a734-de69ea9f39c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:58.781595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d717-2031-4ece-a734-de69ea9f39c0 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:58.782363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3d717-2031-4ece-a734-de69ea9f39c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:58.783765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3d717-2031-4ece-a734-de69ea9f39c0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:58.809043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 352/724] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:11:58 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:11:58.817116 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b083d-4ef0-47b0-97d0-e03915538f80 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:58.940968 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b083d-4ef0-47b0-97d0-e03915538f80 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:58.998749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b8f01-2a6a-4bba-830c-dbdff4bcba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:58.999554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b8f01-2a6a-4bba-830c-dbdff4bcba0e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:58.999835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b8f01-2a6a-4bba-830c-dbdff4bcba0e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.000108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b8f01-2a6a-4bba-830c-dbdff4bcba0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.019224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b8f01-2a6a-4bba-830c-dbdff4bcba0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:59.026953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-5b5b8f01-2a6a-4bba-830c-dbdff4bcba0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:11:59.028101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 373/725] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:59.033901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3d717-2031-4ece-a734-de69ea9f39c0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:59.140853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3d717-2031-4ece-a734-de69ea9f39c0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:59.176866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181b8b0-b3ef-4191-b24c-a90a0dc6a315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:59.178131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b8b0-b3ef-4191-b24c-a90a0dc6a315 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.178420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b8b0-b3ef-4191-b24c-a90a0dc6a315 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.178700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b8b0-b3ef-4191-b24c-a90a0dc6a315 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.179493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181b8b0-b3ef-4191-b24c-a90a0dc6a315 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:59.179800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181b8b0-b3ef-4191-b24c-a90a0dc6a315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:59.181168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181b8b0-b3ef-4191-b24c-a90a0dc6a315 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:59.194351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 353/726] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:11:59.196200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b8f01-2a6a-4bba-830c-dbdff4bcba0e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:59.232714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8b404-e412-45fe-b3d8-95c24ce9a66d None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.233044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8b404-e412-45fe-b3d8-95c24ce9a66d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.233277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8b404-e412-45fe-b3d8-95c24ce9a66d None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.235088 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 354/727] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:11:59.242963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4c31b-72d5-4aa4-aaa8-9a4355102339 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.243251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4c31b-72d5-4aa4-aaa8-9a4355102339 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.243512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4c31b-72d5-4aa4-aaa8-9a4355102339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.266967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b3e4c31b-72d5-4aa4-aaa8-9a4355102339 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:11:59.268162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b3e4c31b-72d5-4aa4-aaa8-9a4355102339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:11:59.328117 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b8f01-2a6a-4bba-830c-dbdff4bcba0e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:59.341147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 355/728] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:11:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 17:11:59.370174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73990438-6437-4f6e-901f-6530a4e42a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:59.371267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990438-6437-4f6e-901f-6530a4e42a89 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.371691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990438-6437-4f6e-901f-6530a4e42a89 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.372108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990438-6437-4f6e-901f-6530a4e42a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.377005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4c31b-72d5-4aa4-aaa8-9a4355102339 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:59.385519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73990438-6437-4f6e-901f-6530a4e42a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:59.387026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73990438-6437-4f6e-901f-6530a4e42a89 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:59.406966 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-73990438-6437-4f6e-901f-6530a4e42a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:11:59.408469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 374/729] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:59.414403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73990438-6437-4f6e-901f-6530a4e42a89 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:59.486150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4c31b-72d5-4aa4-aaa8-9a4355102339 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:59.521844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c90d77-5e9a-4243-8c99-2db347fc5915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:59.523025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c90d77-5e9a-4243-8c99-2db347fc5915 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.523508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c90d77-5e9a-4243-8c99-2db347fc5915 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.523631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73990438-6437-4f6e-901f-6530a4e42a89 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:59.524424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c90d77-5e9a-4243-8c99-2db347fc5915 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.535215 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c90d77-5e9a-4243-8c99-2db347fc5915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:11:59.542840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-40c90d77-5e9a-4243-8c99-2db347fc5915 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:11:59.544810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 356/730] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:11:59.550415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c90d77-5e9a-4243-8c99-2db347fc5915 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:59.558775 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704df515-4bbd-4535-8086-2ede3893919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:59.559757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704df515-4bbd-4535-8086-2ede3893919f None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.560261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704df515-4bbd-4535-8086-2ede3893919f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.560738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704df515-4bbd-4535-8086-2ede3893919f None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.561668 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704df515-4bbd-4535-8086-2ede3893919f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:59.562215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704df515-4bbd-4535-8086-2ede3893919f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:59.563765 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704df515-4bbd-4535-8086-2ede3893919f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:59.577050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 375/731] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:59.582639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704df515-4bbd-4535-8086-2ede3893919f None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:59.727463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c90d77-5e9a-4243-8c99-2db347fc5915 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:59.766273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704df515-4bbd-4535-8086-2ede3893919f None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:59.795729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d06e9f-d7fe-4340-bd8f-4ac49b494a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:59.797004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d06e9f-d7fe-4340-bd8f-4ac49b494a9d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.797486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d06e9f-d7fe-4340-bd8f-4ac49b494a9d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.797989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d06e9f-d7fe-4340-bd8f-4ac49b494a9d None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.798953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d06e9f-d7fe-4340-bd8f-4ac49b494a9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:11:59.799454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d06e9f-d7fe-4340-bd8f-4ac49b494a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:59.801007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d06e9f-d7fe-4340-bd8f-4ac49b494a9d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:59.819006 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 357/732] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:11:59.824717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d06e9f-d7fe-4340-bd8f-4ac49b494a9d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:59.836680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884a57b-5ba2-418e-bca9-6de8a17f2f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:59.837735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a57b-5ba2-418e-bca9-6de8a17f2f3d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.838220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a57b-5ba2-418e-bca9-6de8a17f2f3d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.838708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a57b-5ba2-418e-bca9-6de8a17f2f3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.851460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a57b-5ba2-418e-bca9-6de8a17f2f3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:59.852934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a57b-5ba2-418e-bca9-6de8a17f2f3d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:11:59.867858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-8884a57b-5ba2-418e-bca9-6de8a17f2f3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 17:11:59.873619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 376/733] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:11:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:11:59.874956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726c08-5b0a-4e5e-bd02-f41ef38ae59c None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.875248 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726c08-5b0a-4e5e-bd02-f41ef38ae59c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.875530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726c08-5b0a-4e5e-bd02-f41ef38ae59c None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.877495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 377/734] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:11:59.878241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6726c08-5b0a-4e5e-bd02-f41ef38ae59c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:11:59.944012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d06e9f-d7fe-4340-bd8f-4ac49b494a9d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:11:59.977681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07bd7a-bfae-476d-835d-a3d900f109f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:11:59.978801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07bd7a-bfae-476d-835d-a3d900f109f2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:11:59.979296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07bd7a-bfae-476d-835d-a3d900f109f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:11:59.979742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07bd7a-bfae-476d-835d-a3d900f109f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:11:59.991154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07bd7a-bfae-476d-835d-a3d900f109f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:11:59.992846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07bd7a-bfae-476d-835d-a3d900f109f2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:00.003196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6726c08-5b0a-4e5e-bd02-f41ef38ae59c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:00.009614 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-cf07bd7a-bfae-476d-835d-a3d900f109f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:00.011358 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 358/735] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:00.012698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0aeb9-3815-4c27-8dd0-9ed5ebdd0cb8 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.013178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0aeb9-3815-4c27-8dd0-9ed5ebdd0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.013648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0aeb9-3815-4c27-8dd0-9ed5ebdd0cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.031123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-cfd0aeb9-3815-4c27-8dd0-9ed5ebdd0cb8 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:00.032538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cfd0aeb9-3815-4c27-8dd0-9ed5ebdd0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:00.047008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd57293-29ae-4022-9fdf-b490f9090748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:00.048063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd57293-29ae-4022-9fdf-b490f9090748 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.048353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd57293-29ae-4022-9fdf-b490f9090748 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.048631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd57293-29ae-4022-9fdf-b490f9090748 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.049754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd57293-29ae-4022-9fdf-b490f9090748 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:00.050067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd57293-29ae-4022-9fdf-b490f9090748 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:00.051988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd57293-29ae-4022-9fdf-b490f9090748 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:00.078388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 378/736] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Mar 10 17:11:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:00.081724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd57293-29ae-4022-9fdf-b490f9090748 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:00.126510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 359/737] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 17:12:00.127730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0aeb9-3815-4c27-8dd0-9ed5ebdd0cb8 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:00.207949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd57293-29ae-4022-9fdf-b490f9090748 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:00.249321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d77a0-b28f-4661-a7b9-222a6c583cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:00.250022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d77a0-b28f-4661-a7b9-222a6c583cb8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.250347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d77a0-b28f-4661-a7b9-222a6c583cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.250761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d77a0-b28f-4661-a7b9-222a6c583cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.251631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d77a0-b28f-4661-a7b9-222a6c583cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:00.251937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d77a0-b28f-4661-a7b9-222a6c583cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:00.253772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d77a0-b28f-4661-a7b9-222a6c583cb8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:00.256971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0aeb9-3815-4c27-8dd0-9ed5ebdd0cb8 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:00.270819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 379/738] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:00.270819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d77a0-b28f-4661-a7b9-222a6c583cb8 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:00.297307 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eeecc-444c-4009-9c88-1541c21e9c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:00.297934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eeecc-444c-4009-9c88-1541c21e9c30 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.298216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eeecc-444c-4009-9c88-1541c21e9c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.298499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eeecc-444c-4009-9c88-1541c21e9c30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.368447 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756eeecc-444c-4009-9c88-1541c21e9c30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:00.369262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756eeecc-444c-4009-9c88-1541c21e9c30 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:00.386129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d77a0-b28f-4661-a7b9-222a6c583cb8 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:00.422011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cb0c3-47f6-4a62-8efb-6834926c99e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:00.423288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cb0c3-47f6-4a62-8efb-6834926c99e5 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.423909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cb0c3-47f6-4a62-8efb-6834926c99e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.424367 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cb0c3-47f6-4a62-8efb-6834926c99e5 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.425830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cb0c3-47f6-4a62-8efb-6834926c99e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:00.427910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cb0c3-47f6-4a62-8efb-6834926c99e5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:00.455000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 380/739] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:12:00 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:12:00.456565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cb0c3-47f6-4a62-8efb-6834926c99e5 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:00.489692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 360/740] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 17:12:00.489692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44132b5-f833-4a43-a593-50b5ba79db17 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.489692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44132b5-f833-4a43-a593-50b5ba79db17 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.489692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44132b5-f833-4a43-a593-50b5ba79db17 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.489692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 361/741] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:00.491632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44132b5-f833-4a43-a593-50b5ba79db17 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:00.595790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cb0c3-47f6-4a62-8efb-6834926c99e5 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:00.625538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44132b5-f833-4a43-a593-50b5ba79db17 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:00.640760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21848a65-0533-485e-8339-a6ceba64df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:00.642146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848a65-0533-485e-8339-a6ceba64df9e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.642533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848a65-0533-485e-8339-a6ceba64df9e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.643125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848a65-0533-485e-8339-a6ceba64df9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.652972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21848a65-0533-485e-8339-a6ceba64df9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:00.654470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21848a65-0533-485e-8339-a6ceba64df9e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:00.667892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-21848a65-0533-485e-8339-a6ceba64df9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 17:12:00.673018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 381/742] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Mar 10 17:12:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:00.673018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0172f-c54b-4ac6-b4e2-3a584e9cfd45 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.673018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0172f-c54b-4ac6-b4e2-3a584e9cfd45 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.673018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0172f-c54b-4ac6-b4e2-3a584e9cfd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.673636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1af0cc-4dc0-4928-a068-017a8b1676ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:00.674814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1af0cc-4dc0-4928-a068-017a8b1676ae None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.675106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1af0cc-4dc0-4928-a068-017a8b1676ae None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.675393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1af0cc-4dc0-4928-a068-017a8b1676ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.691037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1af0cc-4dc0-4928-a068-017a8b1676ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:00.691214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ecd0172f-c54b-4ac6-b4e2-3a584e9cfd45 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:00.691744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ecd0172f-c54b-4ac6-b4e2-3a584e9cfd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:00.692184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1af0cc-4dc0-4928-a068-017a8b1676ae None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:00.711405 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-4e1af0cc-4dc0-4928-a068-017a8b1676ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:00.716489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 362/743] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:00.716489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1af0cc-4dc0-4928-a068-017a8b1676ae None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:00.776629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 382/744] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:00.777613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0172f-c54b-4ac6-b4e2-3a584e9cfd45 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:00.820078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1af0cc-4dc0-4928-a068-017a8b1676ae None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:00.855773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b6ee9-23c1-43ad-b112-1e3a6d3283e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:00.857199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b6ee9-23c1-43ad-b112-1e3a6d3283e7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.857642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b6ee9-23c1-43ad-b112-1e3a6d3283e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.858385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b6ee9-23c1-43ad-b112-1e3a6d3283e7 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.859552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b6ee9-23c1-43ad-b112-1e3a6d3283e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:00.860015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b6ee9-23c1-43ad-b112-1e3a6d3283e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:00.861954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b6ee9-23c1-43ad-b112-1e3a6d3283e7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:00.875647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0172f-c54b-4ac6-b4e2-3a584e9cfd45 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:00.885741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 363/745] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Mar 10 17:12:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:00.887256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b6ee9-23c1-43ad-b112-1e3a6d3283e7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:00.912289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af0734-5494-459e-be42-0817572ed09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:00.913103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0734-5494-459e-be42-0817572ed09a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:00.913845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0734-5494-459e-be42-0817572ed09a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:00.913845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0734-5494-459e-be42-0817572ed09a None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:00.914679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af0734-5494-459e-be42-0817572ed09a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:00.915083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af0734-5494-459e-be42-0817572ed09a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:00.916608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af0734-5494-459e-be42-0817572ed09a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:00.929583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 383/746] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:00.930553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af0734-5494-459e-be42-0817572ed09a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.005513 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b6ee9-23c1-43ad-b112-1e3a6d3283e7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.039716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796959c-6e2c-42c2-8d5a-ed679fd26f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.040523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796959c-6e2c-42c2-8d5a-ed679fd26f43 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.040981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796959c-6e2c-42c2-8d5a-ed679fd26f43 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.041098 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796959c-6e2c-42c2-8d5a-ed679fd26f43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.044479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af0734-5494-459e-be42-0817572ed09a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.051675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796959c-6e2c-42c2-8d5a-ed679fd26f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:01.060680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-e796959c-6e2c-42c2-8d5a-ed679fd26f43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:12:01.062251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 364/747] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:12:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:01.062968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796959c-6e2c-42c2-8d5a-ed679fd26f43 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.087836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a95bfc-8dd3-4d6a-9de2-b54cd572cd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.089556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a95bfc-8dd3-4d6a-9de2-b54cd572cd10 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.090062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a95bfc-8dd3-4d6a-9de2-b54cd572cd10 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.090721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a95bfc-8dd3-4d6a-9de2-b54cd572cd10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.106782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a95bfc-8dd3-4d6a-9de2-b54cd572cd10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.109186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a95bfc-8dd3-4d6a-9de2-b54cd572cd10 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.130964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-52a95bfc-8dd3-4d6a-9de2-b54cd572cd10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:01.133194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 384/748] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:01.134859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a95bfc-8dd3-4d6a-9de2-b54cd572cd10 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.165957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796959c-6e2c-42c2-8d5a-ed679fd26f43 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.198928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f83e9-4cfd-4103-a85f-ccfad92a32fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.199775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f83e9-4cfd-4103-a85f-ccfad92a32fe None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.200007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f83e9-4cfd-4103-a85f-ccfad92a32fe None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.200289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f83e9-4cfd-4103-a85f-ccfad92a32fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.207303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f83e9-4cfd-4103-a85f-ccfad92a32fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.209344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f83e9-4cfd-4103-a85f-ccfad92a32fe None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.223778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-925f83e9-4cfd-4103-a85f-ccfad92a32fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:01.231143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 365/749] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:01.235133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f83e9-4cfd-4103-a85f-ccfad92a32fe None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.259689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a95bfc-8dd3-4d6a-9de2-b54cd572cd10 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.303502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd541cf-02c7-4e81-84cf-3e5474581017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.305012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd541cf-02c7-4e81-84cf-3e5474581017 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.305670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd541cf-02c7-4e81-84cf-3e5474581017 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.306263 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd541cf-02c7-4e81-84cf-3e5474581017 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.307532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd541cf-02c7-4e81-84cf-3e5474581017 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:01.308341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd541cf-02c7-4e81-84cf-3e5474581017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.310403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd541cf-02c7-4e81-84cf-3e5474581017 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.322398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 385/750] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:01.323312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd541cf-02c7-4e81-84cf-3e5474581017 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.351433 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f83e9-4cfd-4103-a85f-ccfad92a32fe None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.392167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa494ede-9156-4653-8ded-b5c51cb674ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.393229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa494ede-9156-4653-8ded-b5c51cb674ee None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.393731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa494ede-9156-4653-8ded-b5c51cb674ee None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.394250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa494ede-9156-4653-8ded-b5c51cb674ee None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.395206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa494ede-9156-4653-8ded-b5c51cb674ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:01.395750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa494ede-9156-4653-8ded-b5c51cb674ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.397434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa494ede-9156-4653-8ded-b5c51cb674ee None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.410475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 366/751] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:01.412315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa494ede-9156-4653-8ded-b5c51cb674ee None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.450244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd541cf-02c7-4e81-84cf-3e5474581017 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.492792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f9a76-66b7-42ba-bd0f-2377291f79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.493473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9a76-66b7-42ba-bd0f-2377291f79b0 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.493762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9a76-66b7-42ba-bd0f-2377291f79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.494051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9a76-66b7-42ba-bd0f-2377291f79b0 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.494905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f9a76-66b7-42ba-bd0f-2377291f79b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:01.495350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f9a76-66b7-42ba-bd0f-2377291f79b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.497473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f9a76-66b7-42ba-bd0f-2377291f79b0 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.513478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 386/752] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:01.514149 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f9a76-66b7-42ba-bd0f-2377291f79b0 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.515517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa494ede-9156-4653-8ded-b5c51cb674ee None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.551777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2205fc-1845-495d-9560-8283e3292f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.553784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2205fc-1845-495d-9560-8283e3292f44 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.554323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2205fc-1845-495d-9560-8283e3292f44 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.554903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2205fc-1845-495d-9560-8283e3292f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.566356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2205fc-1845-495d-9560-8283e3292f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.568194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2205fc-1845-495d-9560-8283e3292f44 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.585336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-1c2205fc-1845-495d-9560-8283e3292f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:01.587227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 367/753] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:01.588232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2205fc-1845-495d-9560-8283e3292f44 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.627121 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f9a76-66b7-42ba-bd0f-2377291f79b0 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.668380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b2131-9138-414c-bb54-017796f001c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.669684 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b2131-9138-414c-bb54-017796f001c7 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.670948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b2131-9138-414c-bb54-017796f001c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.671710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b2131-9138-414c-bb54-017796f001c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.679633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b2131-9138-414c-bb54-017796f001c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.681835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b2131-9138-414c-bb54-017796f001c7 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.696815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-3c4b2131-9138-414c-bb54-017796f001c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:01.698578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 387/754] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:01.699432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b2131-9138-414c-bb54-017796f001c7 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.707179 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2205fc-1845-495d-9560-8283e3292f44 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.743452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e41a57-429f-4afa-bffb-0e448b6b8700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.744360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41a57-429f-4afa-bffb-0e448b6b8700 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.744794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41a57-429f-4afa-bffb-0e448b6b8700 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.745223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41a57-429f-4afa-bffb-0e448b6b8700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.746252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e41a57-429f-4afa-bffb-0e448b6b8700 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=35cc9fe9f62844a38f78d52435186f26) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:01.746834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e41a57-429f-4afa-bffb-0e448b6b8700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.748473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e41a57-429f-4afa-bffb-0e448b6b8700 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.754821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 368/755] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/role_assignments?user.id=35cc9fe9f62844a38f78d52435186f26&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:01.756010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e41a57-429f-4afa-bffb-0e448b6b8700 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.822169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b2131-9138-414c-bb54-017796f001c7 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.860431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f951bef-8007-469c-a601-9ca0ddd465b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.861523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f951bef-8007-469c-a601-9ca0ddd465b1 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.862016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f951bef-8007-469c-a601-9ca0ddd465b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.862557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f951bef-8007-469c-a601-9ca0ddd465b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.863604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f951bef-8007-469c-a601-9ca0ddd465b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:01.864136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f951bef-8007-469c-a601-9ca0ddd465b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.864241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e41a57-429f-4afa-bffb-0e448b6b8700 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:01.865884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f951bef-8007-469c-a601-9ca0ddd465b1 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.878763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 388/756] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:01.880636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2470f-a00b-4821-8224-57db109ebf4c None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.881171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2470f-a00b-4821-8224-57db109ebf4c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.881695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2470f-a00b-4821-8224-57db109ebf4c None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.884045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 389/757] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:01.885186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2470f-a00b-4821-8224-57db109ebf4c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:01.905199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbeea2-a26d-4540-b942-eb49c09fd10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:01.905835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbeea2-a26d-4540-b942-eb49c09fd10e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.906066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbeea2-a26d-4540-b942-eb49c09fd10e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.906393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbeea2-a26d-4540-b942-eb49c09fd10e None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.907201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbeea2-a26d-4540-b942-eb49c09fd10e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:01.907508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbeea2-a26d-4540-b942-eb49c09fd10e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:01.909195 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbeea2-a26d-4540-b942-eb49c09fd10e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:01.923225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 369/758] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:01.924600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad4b60-93b7-4397-89bf-1d3fe05ac4c1 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:01.924939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad4b60-93b7-4397-89bf-1d3fe05ac4c1 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:01.925166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad4b60-93b7-4397-89bf-1d3fe05ac4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:01.942333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-f6ad4b60-93b7-4397-89bf-1d3fe05ac4c1 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:01.943609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f6ad4b60-93b7-4397-89bf-1d3fe05ac4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:01.996531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2470f-a00b-4821-8224-57db109ebf4c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:02.014477 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 370/759] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:02.015114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad4b60-93b7-4397-89bf-1d3fe05ac4c1 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:02.043038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288770dc-2c3b-48f7-87da-84f3b982ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:02.044504 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288770dc-2c3b-48f7-87da-84f3b982ca13 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:02.044504 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288770dc-2c3b-48f7-87da-84f3b982ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:02.044504 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288770dc-2c3b-48f7-87da-84f3b982ca13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:02.056634 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288770dc-2c3b-48f7-87da-84f3b982ca13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:02.059191 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288770dc-2c3b-48f7-87da-84f3b982ca13 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:02.078555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-288770dc-2c3b-48f7-87da-84f3b982ca13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 17:12:02.080748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 390/760] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:12:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:02.082068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288770dc-2c3b-48f7-87da-84f3b982ca13 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:02.142419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad4b60-93b7-4397-89bf-1d3fe05ac4c1 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:02.182837 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df5ae5-1269-478a-8767-b72704d0ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:02.183653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df5ae5-1269-478a-8767-b72704d0ecfd None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:02.183930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df5ae5-1269-478a-8767-b72704d0ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:02.184204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df5ae5-1269-478a-8767-b72704d0ecfd None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/89a64b4a57114f77a231a31e16b3923e/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:02.186829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df5ae5-1269-478a-8767-b72704d0ecfd None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=89a64b4a57114f77a231a31e16b3923e, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:02.188531 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df5ae5-1269-478a-8767-b72704d0ecfd None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:02.196000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288770dc-2c3b-48f7-87da-84f3b982ca13 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:02.214136 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 371/761] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:12:02 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/89a64b4a57114f77a231a31e16b3923e/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:12:02.214331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df5ae5-1269-478a-8767-b72704d0ecfd None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:02.262620 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07fb38-95f8-434d-90f1-b72d6d8bc370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:02.263745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07fb38-95f8-434d-90f1-b72d6d8bc370 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:02.264817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07fb38-95f8-434d-90f1-b72d6d8bc370 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:02.265860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07fb38-95f8-434d-90f1-b72d6d8bc370 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:02.266559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07fb38-95f8-434d-90f1-b72d6d8bc370 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:02.269009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07fb38-95f8-434d-90f1-b72d6d8bc370 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:02.292307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-bd07fb38-95f8-434d-90f1-b72d6d8bc370 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 10 17:12:02.296987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 391/762] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Mar 10 17:12:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:02.304056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07fb38-95f8-434d-90f1-b72d6d8bc370 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:02.420734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df5ae5-1269-478a-8767-b72704d0ecfd None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:02.446700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07fb38-95f8-434d-90f1-b72d6d8bc370 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:02.470194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aacc5-6dff-4d4e-a506-f240dc935cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:02.470875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aacc5-6dff-4d4e-a506-f240dc935cc4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:02.471159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aacc5-6dff-4d4e-a506-f240dc935cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:02.471433 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aacc5-6dff-4d4e-a506-f240dc935cc4 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:02.472737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aacc5-6dff-4d4e-a506-f240dc935cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:02.473045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aacc5-6dff-4d4e-a506-f240dc935cc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:02.474828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aacc5-6dff-4d4e-a506-f240dc935cc4 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:02.487453 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be739bb-855e-40eb-982a-97beeb4d62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:02.488481 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be739bb-855e-40eb-982a-97beeb4d62cf None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:02.488961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be739bb-855e-40eb-982a-97beeb4d62cf None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:02.489431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be739bb-855e-40eb-982a-97beeb4d62cf None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:02.490885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be739bb-855e-40eb-982a-97beeb4d62cf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:02.491382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be739bb-855e-40eb-982a-97beeb4d62cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:02.493029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be739bb-855e-40eb-982a-97beeb4d62cf None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:02.498132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 372/763] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Mar 10 17:12:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:02.501091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 392/764] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Mar 10 17:12:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:02.502032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aacc5-6dff-4d4e-a506-f240dc935cc4 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:02.507239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be739bb-855e-40eb-982a-97beeb4d62cf None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:02.621449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aacc5-6dff-4d4e-a506-f240dc935cc4 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:02.662502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b902074-726c-4b8f-9df9-e8f3632fa9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:02.663598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b902074-726c-4b8f-9df9-e8f3632fa9f1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:02.664076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b902074-726c-4b8f-9df9-e8f3632fa9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:02.664631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b902074-726c-4b8f-9df9-e8f3632fa9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:02.668271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be739bb-855e-40eb-982a-97beeb4d62cf None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:02.741283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b902074-726c-4b8f-9df9-e8f3632fa9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:02.743215 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b902074-726c-4b8f-9df9-e8f3632fa9f1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:02.760745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3683e7-e808-44b6-8761-a5a01f5ff748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:02.761425 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3683e7-e808-44b6-8761-a5a01f5ff748 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:02.761714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3683e7-e808-44b6-8761-a5a01f5ff748 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:02.761993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3683e7-e808-44b6-8761-a5a01f5ff748 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:02.762930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3683e7-e808-44b6-8761-a5a01f5ff748 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:02.763049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3683e7-e808-44b6-8761-a5a01f5ff748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:02.764405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3683e7-e808-44b6-8761-a5a01f5ff748 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:02.780472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 393/765] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Mar 10 17:12:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:02.785841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3683e7-e808-44b6-8761-a5a01f5ff748 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:02.854734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 373/766] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:12:02.856390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b902074-726c-4b8f-9df9-e8f3632fa9f1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:02.960240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b902074-726c-4b8f-9df9-e8f3632fa9f1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:02.996970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59600ad-522b-4fbf-bce9-bcd81ce7fa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:02.997684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59600ad-522b-4fbf-bce9-bcd81ce7fa78 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:02.997963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59600ad-522b-4fbf-bce9-bcd81ce7fa78 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:02.998271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59600ad-522b-4fbf-bce9-bcd81ce7fa78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.008830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59600ad-522b-4fbf-bce9-bcd81ce7fa78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:03.010546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59600ad-522b-4fbf-bce9-bcd81ce7fa78 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:03.027265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-e59600ad-522b-4fbf-bce9-bcd81ce7fa78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:03.027579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3683e7-e808-44b6-8761-a5a01f5ff748 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:03.028913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 374/767] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:03.034492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0d59-b5e7-4844-8340-5c7985cf1d83 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.034835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0d59-b5e7-4844-8340-5c7985cf1d83 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.035190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0d59-b5e7-4844-8340-5c7985cf1d83 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.040987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 375/768] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:03.040987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d0d59-b5e7-4844-8340-5c7985cf1d83 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:03.077896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c7e95-21a2-4430-8b99-e6d198f88212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:03.079020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c7e95-21a2-4430-8b99-e6d198f88212 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.080246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c7e95-21a2-4430-8b99-e6d198f88212 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.080678 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c7e95-21a2-4430-8b99-e6d198f88212 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.081621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c7e95-21a2-4430-8b99-e6d198f88212 None admin] RBAC: Adding query filter params (interface=public, service_id=931f87b61d5d42ee97e8d868419a8ef2, region_id=RegionOne) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:03.082079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c7e95-21a2-4430-8b99-e6d198f88212 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:03.084230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c7e95-21a2-4430-8b99-e6d198f88212 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:03.098313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 394/769] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Mar 10 17:12:02 2022] GET /identity/v3/endpoints?service_id=931f87b61d5d42ee97e8d868419a8ef2&interface=public®ion_id=RegionOne => generated 194 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:03.099618 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ec274-a183-4490-ae03-7ca76f62264b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.099946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ec274-a183-4490-ae03-7ca76f62264b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.100224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ec274-a183-4490-ae03-7ca76f62264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.125713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-063ec274-a183-4490-ae03-7ca76f62264b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:03.127264 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-063ec274-a183-4490-ae03-7ca76f62264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:03.155147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d0d59-b5e7-4844-8340-5c7985cf1d83 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:03.196103 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6acb8-a4d8-4116-a858-2f9b4a52f649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:03.197346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6acb8-a4d8-4116-a858-2f9b4a52f649 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.198256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6acb8-a4d8-4116-a858-2f9b4a52f649 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.198725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6acb8-a4d8-4116-a858-2f9b4a52f649 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.199667 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6acb8-a4d8-4116-a858-2f9b4a52f649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:03.200152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6acb8-a4d8-4116-a858-2f9b4a52f649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:03.202168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6acb8-a4d8-4116-a858-2f9b4a52f649 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:03.215083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 395/770] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:03.215083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ec274-a183-4490-ae03-7ca76f62264b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:03.226797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 376/771] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:03.234035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6acb8-a4d8-4116-a858-2f9b4a52f649 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:03.344280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ec274-a183-4490-ae03-7ca76f62264b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:03.349962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6acb8-a4d8-4116-a858-2f9b4a52f649 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:03.377631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b8a6c-398f-4f25-945d-d96437dff1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:03.378449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8a6c-398f-4f25-945d-d96437dff1c7 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.378823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8a6c-398f-4f25-945d-d96437dff1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.379128 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8a6c-398f-4f25-945d-d96437dff1c7 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.380080 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b8a6c-398f-4f25-945d-d96437dff1c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:03.381962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b8a6c-398f-4f25-945d-d96437dff1c7 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:03.387311 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 396/772] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Mar 10 17:12:03 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:03.392219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c00723-8e87-4ef7-baf8-744953bb9e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:03.393328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c00723-8e87-4ef7-baf8-744953bb9e14 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.393778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c00723-8e87-4ef7-baf8-744953bb9e14 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.394244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c00723-8e87-4ef7-baf8-744953bb9e14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.395178 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b8a6c-398f-4f25-945d-d96437dff1c7 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:03.403364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c00723-8e87-4ef7-baf8-744953bb9e14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:03.405599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c00723-8e87-4ef7-baf8-744953bb9e14 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:03.422763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-83c00723-8e87-4ef7-baf8-744953bb9e14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:03.430489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 377/773] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:03.432267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c00723-8e87-4ef7-baf8-744953bb9e14 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:03.550836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c00723-8e87-4ef7-baf8-744953bb9e14 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:03.590265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5190a94-ba62-43fd-83a0-def7b623ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:03.591262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5190a94-ba62-43fd-83a0-def7b623ab58 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.591736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5190a94-ba62-43fd-83a0-def7b623ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.592185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5190a94-ba62-43fd-83a0-def7b623ab58 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.593163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5190a94-ba62-43fd-83a0-def7b623ab58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:03.593662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5190a94-ba62-43fd-83a0-def7b623ab58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:03.595327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5190a94-ba62-43fd-83a0-def7b623ab58 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:03.605356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b8a6c-398f-4f25-945d-d96437dff1c7 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:03.614250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 378/774] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:03.616383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5190a94-ba62-43fd-83a0-def7b623ab58 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:03.673826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7970ae-c99e-476b-887a-044e329f1538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:03.674768 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7970ae-c99e-476b-887a-044e329f1538 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.675118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7970ae-c99e-476b-887a-044e329f1538 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.675505 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7970ae-c99e-476b-887a-044e329f1538 None admin] PATH_INFO: `/v3/services/network` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.676248 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7970ae-c99e-476b-887a-044e329f1538 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:03.678447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7970ae-c99e-476b-887a-044e329f1538 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:03.693583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-2e7970ae-c99e-476b-887a-044e329f1538 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 10 17:12:03.701357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 397/775] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:03 2022] GET /identity/v3/services/network => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:03.702926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7970ae-c99e-476b-887a-044e329f1538 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:03.734729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5190a94-ba62-43fd-83a0-def7b623ab58 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:03.777104 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b633b6-bb3a-485c-9c34-53d414863bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:03.778247 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b633b6-bb3a-485c-9c34-53d414863bcf None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.778534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b633b6-bb3a-485c-9c34-53d414863bcf None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.778813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b633b6-bb3a-485c-9c34-53d414863bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.779921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b633b6-bb3a-485c-9c34-53d414863bcf None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=e4f27325efd04f74b572def6a7060d9d) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:03.780231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b633b6-bb3a-485c-9c34-53d414863bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:03.782296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b633b6-bb3a-485c-9c34-53d414863bcf None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:03.793848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 379/776] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:03 2022] GET /identity/v3/role_assignments?user.id=e4f27325efd04f74b572def6a7060d9d&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:03.816130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7970ae-c99e-476b-887a-044e329f1538 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:03.856394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53af8ef-4ee0-49f2-aeb0-ca3d35384239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:03.857009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53af8ef-4ee0-49f2-aeb0-ca3d35384239 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:03.857291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53af8ef-4ee0-49f2-aeb0-ca3d35384239 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:03.857565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53af8ef-4ee0-49f2-aeb0-ca3d35384239 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:03.858348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53af8ef-4ee0-49f2-aeb0-ca3d35384239 None admin] RBAC: Adding query filter params (name=network) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:03.858653 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53af8ef-4ee0-49f2-aeb0-ca3d35384239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:03.860065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53af8ef-4ee0-49f2-aeb0-ca3d35384239 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:03.866366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 398/777] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:03.872260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b633b6-bb3a-485c-9c34-53d414863bcf None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:03.993544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b633b6-bb3a-485c-9c34-53d414863bcf None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:04.037638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18eef8e-306f-4db9-aeaf-adeaf48fed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:04.038542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eef8e-306f-4db9-aeaf-adeaf48fed30 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:04.038824 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eef8e-306f-4db9-aeaf-adeaf48fed30 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:04.039099 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eef8e-306f-4db9-aeaf-adeaf48fed30 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:04.039817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18eef8e-306f-4db9-aeaf-adeaf48fed30 None admin] RBAC: Adding query filter params (type=network) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:04.040892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18eef8e-306f-4db9-aeaf-adeaf48fed30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:04.041498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18eef8e-306f-4db9-aeaf-adeaf48fed30 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:04.048613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 380/778] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:04.054643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53af8ef-4ee0-49f2-aeb0-ca3d35384239 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:04.168501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53af8ef-4ee0-49f2-aeb0-ca3d35384239 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:04.202214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdad05-1cd9-46ca-a4a3-9296880be59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:04.202887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdad05-1cd9-46ca-a4a3-9296880be59f None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:04.203172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdad05-1cd9-46ca-a4a3-9296880be59f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:04.203450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdad05-1cd9-46ca-a4a3-9296880be59f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:04.204232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdad05-1cd9-46ca-a4a3-9296880be59f None admin] RBAC: Adding query filter params (interface=public, service_id=0605c899f3dc4c6894ec4249ab6b99b8, region_id=RegionOne) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:04.204542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdad05-1cd9-46ca-a4a3-9296880be59f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:04.205908 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdad05-1cd9-46ca-a4a3-9296880be59f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:04.211806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 399/779] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Mar 10 17:12:04 2022] GET /identity/v3/endpoints?service_id=0605c899f3dc4c6894ec4249ab6b99b8&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:04.217258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18eef8e-306f-4db9-aeaf-adeaf48fed30 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:04.363994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18eef8e-306f-4db9-aeaf-adeaf48fed30 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:04.406924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e242bd-1087-4544-8e6e-b0a486bafb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:04.407613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e242bd-1087-4544-8e6e-b0a486bafb98 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:04.407895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e242bd-1087-4544-8e6e-b0a486bafb98 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:04.408169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e242bd-1087-4544-8e6e-b0a486bafb98 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:04.408854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e242bd-1087-4544-8e6e-b0a486bafb98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:04.410251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e242bd-1087-4544-8e6e-b0a486bafb98 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:04.416150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 381/780] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Mar 10 17:12:04 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:04.465757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d430c-6b90-409b-a794-69c3724bbec0 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:04.466048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d430c-6b90-409b-a794-69c3724bbec0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:04.466261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d430c-6b90-409b-a794-69c3724bbec0 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:04.468380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 400/781] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:04.475238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245156e-86ba-4906-98d0-cb1f7b027d5c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:04.475558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245156e-86ba-4906-98d0-cb1f7b027d5c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:04.475786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245156e-86ba-4906-98d0-cb1f7b027d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:04.503315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-8245156e-86ba-4906-98d0-cb1f7b027d5c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:04.504531 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8245156e-86ba-4906-98d0-cb1f7b027d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:04.591654 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 382/782] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:04.631679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d430c-6b90-409b-a794-69c3724bbec0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:04.766564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d430c-6b90-409b-a794-69c3724bbec0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:04.806258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac5d02-217f-4aee-a433-88c74ffb0d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:04.807535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac5d02-217f-4aee-a433-88c74ffb0d82 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:04.808020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac5d02-217f-4aee-a433-88c74ffb0d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:04.808511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac5d02-217f-4aee-a433-88c74ffb0d82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:04.819266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac5d02-217f-4aee-a433-88c74ffb0d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:04.826666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-f9ac5d02-217f-4aee-a433-88c74ffb0d82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:12:04.828506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 401/783] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:04.834556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245156e-86ba-4906-98d0-cb1f7b027d5c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:04.863879 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eacf21-6c92-4307-ae4e-036d5a40fb2d None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:04.864459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eacf21-6c92-4307-ae4e-036d5a40fb2d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:04.864773 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eacf21-6c92-4307-ae4e-036d5a40fb2d None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:04.866567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 402/784] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:04.887718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e8e2-3839-4179-baf4-c7b9babdf10f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:04.888034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e8e2-3839-4179-baf4-c7b9babdf10f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:04.888310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e8e2-3839-4179-baf4-c7b9babdf10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:04.919086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4034e8e2-3839-4179-baf4-c7b9babdf10f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:04.920315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4034e8e2-3839-4179-baf4-c7b9babdf10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:04.952010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245156e-86ba-4906-98d0-cb1f7b027d5c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:05.006813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add3356-c1e0-4126-9a1a-85749d2b637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:05.007869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3356-c1e0-4126-9a1a-85749d2b637e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:05.008353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3356-c1e0-4126-9a1a-85749d2b637e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:05.008840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3356-c1e0-4126-9a1a-85749d2b637e None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:05.009801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add3356-c1e0-4126-9a1a-85749d2b637e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:05.010333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add3356-c1e0-4126-9a1a-85749d2b637e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:05.011906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add3356-c1e0-4126-9a1a-85749d2b637e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:05.024809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 403/785] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:05.024985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 383/786] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:05.031044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e8e2-3839-4179-baf4-c7b9babdf10f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:05.121264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add3356-c1e0-4126-9a1a-85749d2b637e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:05.176727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e8e2-3839-4179-baf4-c7b9babdf10f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:05.238909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88de7bb-9344-48cc-b88b-be581bca8c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:05.239768 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88de7bb-9344-48cc-b88b-be581bca8c0f None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:05.240050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88de7bb-9344-48cc-b88b-be581bca8c0f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:05.240326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88de7bb-9344-48cc-b88b-be581bca8c0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:05.259874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88de7bb-9344-48cc-b88b-be581bca8c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:05.261329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88de7bb-9344-48cc-b88b-be581bca8c0f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:05.299604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-e88de7bb-9344-48cc-b88b-be581bca8c0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:05.300761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 404/787] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:05.309364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add3356-c1e0-4126-9a1a-85749d2b637e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:05.311274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88de7bb-9344-48cc-b88b-be581bca8c0f None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:05.385353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71710ed6-7761-40ee-b9d0-4dd09b2764d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:05.386241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71710ed6-7761-40ee-b9d0-4dd09b2764d7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:05.386527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71710ed6-7761-40ee-b9d0-4dd09b2764d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:05.386848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71710ed6-7761-40ee-b9d0-4dd09b2764d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:05.417609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71710ed6-7761-40ee-b9d0-4dd09b2764d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:05.430405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88de7bb-9344-48cc-b88b-be581bca8c0f None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:05.434187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-71710ed6-7761-40ee-b9d0-4dd09b2764d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:12:05.435835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 384/788] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:05.441270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71710ed6-7761-40ee-b9d0-4dd09b2764d7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:05.464047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267525e2-7e10-4a9c-95dd-4628e598eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:05.464716 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267525e2-7e10-4a9c-95dd-4628e598eb73 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:05.464998 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267525e2-7e10-4a9c-95dd-4628e598eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:05.465273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267525e2-7e10-4a9c-95dd-4628e598eb73 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:05.465988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267525e2-7e10-4a9c-95dd-4628e598eb73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:05.466318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267525e2-7e10-4a9c-95dd-4628e598eb73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:05.467677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267525e2-7e10-4a9c-95dd-4628e598eb73 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:05.480011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 405/789] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:05.490289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267525e2-7e10-4a9c-95dd-4628e598eb73 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:05.566159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71710ed6-7761-40ee-b9d0-4dd09b2764d7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:05.603190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80216-5a9d-4f48-8dff-5b9407f285cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:05.604182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80216-5a9d-4f48-8dff-5b9407f285cf None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:05.604640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80216-5a9d-4f48-8dff-5b9407f285cf None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:05.605090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80216-5a9d-4f48-8dff-5b9407f285cf None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:05.606007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80216-5a9d-4f48-8dff-5b9407f285cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:05.606648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80216-5a9d-4f48-8dff-5b9407f285cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:05.608462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80216-5a9d-4f48-8dff-5b9407f285cf None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:05.620610 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 385/790] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:05.625490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80216-5a9d-4f48-8dff-5b9407f285cf None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:05.682415 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267525e2-7e10-4a9c-95dd-4628e598eb73 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:05.748008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e896b-ae7f-4d5f-9125-9ff3ea01233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:05.749139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e896b-ae7f-4d5f-9125-9ff3ea01233d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:05.749600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e896b-ae7f-4d5f-9125-9ff3ea01233d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:05.750048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e896b-ae7f-4d5f-9125-9ff3ea01233d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:05.759168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e896b-ae7f-4d5f-9125-9ff3ea01233d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:05.761435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e896b-ae7f-4d5f-9125-9ff3ea01233d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:05.776956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-f27e896b-ae7f-4d5f-9125-9ff3ea01233d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 17:12:05.783051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 406/791] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:12:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:05.785493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e896b-ae7f-4d5f-9125-9ff3ea01233d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:05.799817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80216-5a9d-4f48-8dff-5b9407f285cf None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:05.867961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02298d-c4d5-4d81-85f4-33b8d6b179fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:05.868693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02298d-c4d5-4d81-85f4-33b8d6b179fb None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:05.868963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02298d-c4d5-4d81-85f4-33b8d6b179fb None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:05.869229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02298d-c4d5-4d81-85f4-33b8d6b179fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:05.884247 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02298d-c4d5-4d81-85f4-33b8d6b179fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:05.885709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02298d-c4d5-4d81-85f4-33b8d6b179fb None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:05.910770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-1d02298d-c4d5-4d81-85f4-33b8d6b179fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:05.919911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 386/792] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:05.926150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02298d-c4d5-4d81-85f4-33b8d6b179fb None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:05.967472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e896b-ae7f-4d5f-9125-9ff3ea01233d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.007457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203a30e-d1c0-49b7-a148-0b8c199a16d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.008141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203a30e-d1c0-49b7-a148-0b8c199a16d6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.008423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203a30e-d1c0-49b7-a148-0b8c199a16d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.008695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203a30e-d1c0-49b7-a148-0b8c199a16d6 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.009528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203a30e-d1c0-49b7-a148-0b8c199a16d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:06.009834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203a30e-d1c0-49b7-a148-0b8c199a16d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.011302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203a30e-d1c0-49b7-a148-0b8c199a16d6 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.042584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 407/793] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Mar 10 17:12:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:06.051214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203a30e-d1c0-49b7-a148-0b8c199a16d6 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:06.090880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02298d-c4d5-4d81-85f4-33b8d6b179fb None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.126776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971038-4bce-47a5-8536-a13eb4544eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.127415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971038-4bce-47a5-8536-a13eb4544eb1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.127712 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971038-4bce-47a5-8536-a13eb4544eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.127987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971038-4bce-47a5-8536-a13eb4544eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.128709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971038-4bce-47a5-8536-a13eb4544eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:06.129013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971038-4bce-47a5-8536-a13eb4544eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.130945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971038-4bce-47a5-8536-a13eb4544eb1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.143317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 387/794] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:06.151035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971038-4bce-47a5-8536-a13eb4544eb1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:06.212922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203a30e-d1c0-49b7-a148-0b8c199a16d6 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.251092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57a08-f1dc-46d8-84e6-378a689ffdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.252427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57a08-f1dc-46d8-84e6-378a689ffdd6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.253108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57a08-f1dc-46d8-84e6-378a689ffdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.253594 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57a08-f1dc-46d8-84e6-378a689ffdd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.271803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b57a08-f1dc-46d8-84e6-378a689ffdd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.274358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b57a08-f1dc-46d8-84e6-378a689ffdd6 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.285307 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971038-4bce-47a5-8536-a13eb4544eb1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.296518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-76b57a08-f1dc-46d8-84e6-378a689ffdd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:06.298964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 408/795] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:06.300735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2fad1-d9df-4893-bf04-f8d51cbd79ae None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.301220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2fad1-d9df-4893-bf04-f8d51cbd79ae None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.301846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2fad1-d9df-4893-bf04-f8d51cbd79ae None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.309729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 409/796] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:06.311057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2fad1-d9df-4893-bf04-f8d51cbd79ae None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:06.327263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5301c-09aa-40ed-a034-b9e57ff5dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.328179 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5301c-09aa-40ed-a034-b9e57ff5dc23 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.328564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5301c-09aa-40ed-a034-b9e57ff5dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.328940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5301c-09aa-40ed-a034-b9e57ff5dc23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.336603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5301c-09aa-40ed-a034-b9e57ff5dc23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.338236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5301c-09aa-40ed-a034-b9e57ff5dc23 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.352053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-c2d5301c-09aa-40ed-a034-b9e57ff5dc23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 17:12:06.358006 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 388/797] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Mar 10 17:12:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:06.359439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b629e-8747-4076-8af7-11295eee05f2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.359912 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b629e-8747-4076-8af7-11295eee05f2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.360224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b629e-8747-4076-8af7-11295eee05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.378560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9a9b629e-8747-4076-8af7-11295eee05f2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:06.379807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9a9b629e-8747-4076-8af7-11295eee05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:06.430438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2fad1-d9df-4893-bf04-f8d51cbd79ae None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.458130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 389/798] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:06.458130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b629e-8747-4076-8af7-11295eee05f2 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:06.494172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d42e1-f377-427b-81c8-dce7ad6dcfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.495519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d42e1-f377-427b-81c8-dce7ad6dcfcd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.496044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d42e1-f377-427b-81c8-dce7ad6dcfcd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.496464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d42e1-f377-427b-81c8-dce7ad6dcfcd None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.497308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d42e1-f377-427b-81c8-dce7ad6dcfcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:06.497835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d42e1-f377-427b-81c8-dce7ad6dcfcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.500256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d42e1-f377-427b-81c8-dce7ad6dcfcd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.514989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 410/799] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:06.516026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d42e1-f377-427b-81c8-dce7ad6dcfcd None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:06.566884 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b629e-8747-4076-8af7-11295eee05f2 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.601268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24a8ba-c683-4c16-bd77-b6f120137ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.602227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24a8ba-c683-4c16-bd77-b6f120137ffd None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.602649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24a8ba-c683-4c16-bd77-b6f120137ffd None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.603076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24a8ba-c683-4c16-bd77-b6f120137ffd None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.604026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24a8ba-c683-4c16-bd77-b6f120137ffd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:06.604484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24a8ba-c683-4c16-bd77-b6f120137ffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.606039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24a8ba-c683-4c16-bd77-b6f120137ffd None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.622188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d42e1-f377-427b-81c8-dce7ad6dcfcd None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.623641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 390/800] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Mar 10 17:12:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:06.624602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24a8ba-c683-4c16-bd77-b6f120137ffd None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:06.661743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d47fd-451a-4ab1-95f8-c25753da5281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.662820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d47fd-451a-4ab1-95f8-c25753da5281 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.663246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d47fd-451a-4ab1-95f8-c25753da5281 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.663661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d47fd-451a-4ab1-95f8-c25753da5281 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.664444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d47fd-451a-4ab1-95f8-c25753da5281 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.666375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d47fd-451a-4ab1-95f8-c25753da5281 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.678933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-f66d47fd-451a-4ab1-95f8-c25753da5281 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 10 17:12:06.684880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 411/801] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Mar 10 17:12:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:06.684880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21fa2f-40bc-4c4a-909d-ac2146bb1dbf None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.684880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21fa2f-40bc-4c4a-909d-ac2146bb1dbf None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.684880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21fa2f-40bc-4c4a-909d-ac2146bb1dbf None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.684880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 412/802] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:06.684880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21fa2f-40bc-4c4a-909d-ac2146bb1dbf None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:06.729498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24a8ba-c683-4c16-bd77-b6f120137ffd None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.769825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56f3f-d758-4170-9927-eb401b5569db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.770651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56f3f-d758-4170-9927-eb401b5569db None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.771457 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56f3f-d758-4170-9927-eb401b5569db None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.771752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56f3f-d758-4170-9927-eb401b5569db None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.778503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b56f3f-d758-4170-9927-eb401b5569db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.779952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b56f3f-d758-4170-9927-eb401b5569db None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.792905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-15b56f3f-d758-4170-9927-eb401b5569db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:06.799298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 391/803] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:06.799298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56f3f-d758-4170-9927-eb401b5569db None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:06.815389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21fa2f-40bc-4c4a-909d-ac2146bb1dbf None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.849318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a301919-782b-4558-a6a3-de0b2e11e772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.849969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a301919-782b-4558-a6a3-de0b2e11e772 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.850286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a301919-782b-4558-a6a3-de0b2e11e772 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.850571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a301919-782b-4558-a6a3-de0b2e11e772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.907974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56f3f-d758-4170-9927-eb401b5569db None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:06.928490 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a301919-782b-4558-a6a3-de0b2e11e772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.929885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a301919-782b-4558-a6a3-de0b2e11e772 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.947007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eb831-d2eb-474e-b448-13082de68dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:06.948061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eb831-d2eb-474e-b448-13082de68dd7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.948538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eb831-d2eb-474e-b448-13082de68dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.949031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eb831-d2eb-474e-b448-13082de68dd7 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.949978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eb831-d2eb-474e-b448-13082de68dd7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:06.950536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eb831-d2eb-474e-b448-13082de68dd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:06.952163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eb831-d2eb-474e-b448-13082de68dd7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:06.962914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 392/804] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Mar 10 17:12:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:06.964715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805dfc8-c503-458a-af27-def9728c7c25 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:06.965243 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805dfc8-c503-458a-af27-def9728c7c25 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:06.965716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805dfc8-c503-458a-af27-def9728c7c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:06.983703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-4805dfc8-c503-458a-af27-def9728c7c25 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:06.985218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-4805dfc8-c503-458a-af27-def9728c7c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:07.039142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 413/805] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:12:07.040041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a301919-782b-4558-a6a3-de0b2e11e772 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.054264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 393/806] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:07.055425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805dfc8-c503-458a-af27-def9728c7c25 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.165173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a301919-782b-4558-a6a3-de0b2e11e772 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.167064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805dfc8-c503-458a-af27-def9728c7c25 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.199890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdd5a3-f81f-44bd-8934-7a8fa6d96eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:07.200794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdd5a3-f81f-44bd-8934-7a8fa6d96eb1 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.201081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdd5a3-f81f-44bd-8934-7a8fa6d96eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.201380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdd5a3-f81f-44bd-8934-7a8fa6d96eb1 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.202179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdd5a3-f81f-44bd-8934-7a8fa6d96eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:07.202785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdd5a3-f81f-44bd-8934-7a8fa6d96eb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:07.204315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdd5a3-f81f-44bd-8934-7a8fa6d96eb1 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:07.209587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb151309-5892-4762-afa2-633b4e500c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:07.210539 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb151309-5892-4762-afa2-633b4e500c37 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.211101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb151309-5892-4762-afa2-633b4e500c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.211594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb151309-5892-4762-afa2-633b4e500c37 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.213079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb151309-5892-4762-afa2-633b4e500c37 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:07.213591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb151309-5892-4762-afa2-633b4e500c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:07.215908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb151309-5892-4762-afa2-633b4e500c37 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:07.222000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 414/807] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:07.222000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdd5a3-f81f-44bd-8934-7a8fa6d96eb1 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.227820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 394/808] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Mar 10 17:12:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:07.233651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb151309-5892-4762-afa2-633b4e500c37 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.336548 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdd5a3-f81f-44bd-8934-7a8fa6d96eb1 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.346126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb151309-5892-4762-afa2-633b4e500c37 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.367462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da4fdc-2807-416d-99a2-3cbf336c48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:07.368257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da4fdc-2807-416d-99a2-3cbf336c48d0 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.368543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da4fdc-2807-416d-99a2-3cbf336c48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.368822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da4fdc-2807-416d-99a2-3cbf336c48d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.377844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deaed9-32a9-4276-bb4c-fad333e12012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:07.378666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deaed9-32a9-4276-bb4c-fad333e12012 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.378950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deaed9-32a9-4276-bb4c-fad333e12012 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.379043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da4fdc-2807-416d-99a2-3cbf336c48d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:07.379226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deaed9-32a9-4276-bb4c-fad333e12012 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.380949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da4fdc-2807-416d-99a2-3cbf336c48d0 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:07.389475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deaed9-32a9-4276-bb4c-fad333e12012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:07.397090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-01deaed9-32a9-4276-bb4c-fad333e12012 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:12:07.397534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-a7da4fdc-2807-416d-99a2-3cbf336c48d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:07.398290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 395/809] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:12:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:07.403045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 415/810] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:07.403178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deaed9-32a9-4276-bb4c-fad333e12012 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.403271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da4fdc-2807-416d-99a2-3cbf336c48d0 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.491240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da4fdc-2807-416d-99a2-3cbf336c48d0 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.494827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deaed9-32a9-4276-bb4c-fad333e12012 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.523035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049ca50-cb75-44fe-8702-ba464929b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:07.523678 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ca50-cb75-44fe-8702-ba464929b8a2 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.523962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ca50-cb75-44fe-8702-ba464929b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.524242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ca50-cb75-44fe-8702-ba464929b8a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.524967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049ca50-cb75-44fe-8702-ba464929b8a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:07.526345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049ca50-cb75-44fe-8702-ba464929b8a2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:07.526795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ac411-1ea7-49cb-9025-af360a68ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:07.527670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ac411-1ea7-49cb-9025-af360a68ec64 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.527952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ac411-1ea7-49cb-9025-af360a68ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.528227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ac411-1ea7-49cb-9025-af360a68ec64 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/35cc9fe9f62844a38f78d52435186f26/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.530207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ac411-1ea7-49cb-9025-af360a68ec64 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=35cc9fe9f62844a38f78d52435186f26, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:07.531627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ac411-1ea7-49cb-9025-af360a68ec64 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:07.544478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 396/811] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:12:07 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/35cc9fe9f62844a38f78d52435186f26/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:12:07.545666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad55e8-aa8a-4495-927c-2ef0d4dfe0e7 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.545958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad55e8-aa8a-4495-927c-2ef0d4dfe0e7 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.546532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad55e8-aa8a-4495-927c-2ef0d4dfe0e7 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.552674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 397/812] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:07.552674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad55e8-aa8a-4495-927c-2ef0d4dfe0e7 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.558346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 416/813] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Mar 10 17:12:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:12:07.559439 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049ca50-cb75-44fe-8702-ba464929b8a2 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.689169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049ca50-cb75-44fe-8702-ba464929b8a2 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.689378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad55e8-aa8a-4495-927c-2ef0d4dfe0e7 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.728524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35297e27-460d-4ef9-8ac8-677f61371bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:07.729215 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35297e27-460d-4ef9-8ac8-677f61371bac None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.729510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35297e27-460d-4ef9-8ac8-677f61371bac None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.729763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35297e27-460d-4ef9-8ac8-677f61371bac None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.730060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8852944-9ffa-4cf1-b129-36fb6b8e7b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:07.730569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35297e27-460d-4ef9-8ac8-677f61371bac None admin] RBAC: Adding query filter params (name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:07.730874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35297e27-460d-4ef9-8ac8-677f61371bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:07.731421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8852944-9ffa-4cf1-b129-36fb6b8e7b7c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.731926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8852944-9ffa-4cf1-b129-36fb6b8e7b7c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.732287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35297e27-460d-4ef9-8ac8-677f61371bac None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:07.732646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8852944-9ffa-4cf1-b129-36fb6b8e7b7c None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.733615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8852944-9ffa-4cf1-b129-36fb6b8e7b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:07.734158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8852944-9ffa-4cf1-b129-36fb6b8e7b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:07.735788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8852944-9ffa-4cf1-b129-36fb6b8e7b7c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:07.743561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 398/814] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:12:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:07.744828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878f74d-bcb6-4495-a752-018dab7092e0 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.745120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878f74d-bcb6-4495-a752-018dab7092e0 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.745402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878f74d-bcb6-4495-a752-018dab7092e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.751924 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 417/815] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:07.753110 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8852944-9ffa-4cf1-b129-36fb6b8e7b7c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.763839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1878f74d-bcb6-4495-a752-018dab7092e0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:07.765017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1878f74d-bcb6-4495-a752-018dab7092e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:07.848599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 399/816] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:07.849732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878f74d-bcb6-4495-a752-018dab7092e0 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:07.893087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8852944-9ffa-4cf1-b129-36fb6b8e7b7c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.937015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784bd2-5bda-40b9-a56c-3876400e8f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:07.938452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784bd2-5bda-40b9-a56c-3876400e8f40 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:07.939266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784bd2-5bda-40b9-a56c-3876400e8f40 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:07.939914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784bd2-5bda-40b9-a56c-3876400e8f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:07.953726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784bd2-5bda-40b9-a56c-3876400e8f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:07.956190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784bd2-5bda-40b9-a56c-3876400e8f40 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:07.960698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878f74d-bcb6-4495-a752-018dab7092e0 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:07.976706 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-3a784bd2-5bda-40b9-a56c-3876400e8f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:07.978459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 418/817] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:07.979754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784bd2-5bda-40b9-a56c-3876400e8f40 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.004450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61ff1-b387-482d-80b9-a49ca98b7596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.006038 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61ff1-b387-482d-80b9-a49ca98b7596 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.006521 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61ff1-b387-482d-80b9-a49ca98b7596 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.007046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61ff1-b387-482d-80b9-a49ca98b7596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.016295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e61ff1-b387-482d-80b9-a49ca98b7596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.017895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e61ff1-b387-482d-80b9-a49ca98b7596 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.034615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-99e61ff1-b387-482d-80b9-a49ca98b7596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:08.037389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 400/818] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:08.038892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61ff1-b387-482d-80b9-a49ca98b7596 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.079133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784bd2-5bda-40b9-a56c-3876400e8f40 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.113421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f3370-1283-4f82-99e1-23f24ff2f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.114404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3370-1283-4f82-99e1-23f24ff2f78c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.115444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3370-1283-4f82-99e1-23f24ff2f78c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.116360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3370-1283-4f82-99e1-23f24ff2f78c None admin] PATH_INFO: `/v3/services/network` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.116634 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f3370-1283-4f82-99e1-23f24ff2f78c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.118163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f3370-1283-4f82-99e1-23f24ff2f78c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.129267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-1c9f3370-1283-4f82-99e1-23f24ff2f78c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 10 17:12:08.135317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 419/819] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:07 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:08.135317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f3370-1283-4f82-99e1-23f24ff2f78c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.150997 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61ff1-b387-482d-80b9-a49ca98b7596 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.186983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f7c54-fd01-45d4-9858-47b12f20c273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.187866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f7c54-fd01-45d4-9858-47b12f20c273 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.188293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f7c54-fd01-45d4-9858-47b12f20c273 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.188749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f7c54-fd01-45d4-9858-47b12f20c273 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.189608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f7c54-fd01-45d4-9858-47b12f20c273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:08.190071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f7c54-fd01-45d4-9858-47b12f20c273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.191599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f7c54-fd01-45d4-9858-47b12f20c273 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.204182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 401/820] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:08.205229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f7c54-fd01-45d4-9858-47b12f20c273 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.234303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f3370-1283-4f82-99e1-23f24ff2f78c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.268580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4368b3-8881-491d-b88a-fc6c47775bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.269343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4368b3-8881-491d-b88a-fc6c47775bfd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.269733 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4368b3-8881-491d-b88a-fc6c47775bfd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.270131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4368b3-8881-491d-b88a-fc6c47775bfd None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.271650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4368b3-8881-491d-b88a-fc6c47775bfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:08.272445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4368b3-8881-491d-b88a-fc6c47775bfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.273704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4368b3-8881-491d-b88a-fc6c47775bfd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.286740 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 420/821] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:08.287778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4368b3-8881-491d-b88a-fc6c47775bfd None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.309131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f7c54-fd01-45d4-9858-47b12f20c273 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.344400 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7918-c5d5-452e-9b00-02014075bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.345345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7918-c5d5-452e-9b00-02014075bce4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.345788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7918-c5d5-452e-9b00-02014075bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.346238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7918-c5d5-452e-9b00-02014075bce4 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.347079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b7918-c5d5-452e-9b00-02014075bce4 None admin] RBAC: Adding query filter params (name=network) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:08.347527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b7918-c5d5-452e-9b00-02014075bce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.349577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b7918-c5d5-452e-9b00-02014075bce4 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.354328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 402/822] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:08.355239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7918-c5d5-452e-9b00-02014075bce4 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.394656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4368b3-8881-491d-b88a-fc6c47775bfd None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.430543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c77a5a-73fd-410d-b952-cde052cd88f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.430783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c77a5a-73fd-410d-b952-cde052cd88f5 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.431052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c77a5a-73fd-410d-b952-cde052cd88f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.431333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c77a5a-73fd-410d-b952-cde052cd88f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.438991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c77a5a-73fd-410d-b952-cde052cd88f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.440231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c77a5a-73fd-410d-b952-cde052cd88f5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.455033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-24c77a5a-73fd-410d-b952-cde052cd88f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 17:12:08.456542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 421/823] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:12:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:08.457395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c77a5a-73fd-410d-b952-cde052cd88f5 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.461558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7918-c5d5-452e-9b00-02014075bce4 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.495810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef227a7-fb55-4112-8f1a-eaeda323870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.496730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef227a7-fb55-4112-8f1a-eaeda323870a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.497173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef227a7-fb55-4112-8f1a-eaeda323870a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.497588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef227a7-fb55-4112-8f1a-eaeda323870a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.498586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef227a7-fb55-4112-8f1a-eaeda323870a None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=89a64b4a57114f77a231a31e16b3923e) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:08.499040 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef227a7-fb55-4112-8f1a-eaeda323870a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.500602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef227a7-fb55-4112-8f1a-eaeda323870a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.507056 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 403/824] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:08 2022] GET /identity/v3/role_assignments?user.id=89a64b4a57114f77a231a31e16b3923e&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:08.508124 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef227a7-fb55-4112-8f1a-eaeda323870a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.614637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef227a7-fb55-4112-8f1a-eaeda323870a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.650745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89a84-e997-4f53-be04-f2c96db7048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.651707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89a84-e997-4f53-be04-f2c96db7048c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.652134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89a84-e997-4f53-be04-f2c96db7048c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.652552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89a84-e997-4f53-be04-f2c96db7048c None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.653537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89a84-e997-4f53-be04-f2c96db7048c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:08.653991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89a84-e997-4f53-be04-f2c96db7048c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.655657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89a84-e997-4f53-be04-f2c96db7048c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.660382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c77a5a-73fd-410d-b952-cde052cd88f5 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.675887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 404/825] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Mar 10 17:12:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:08.680900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89a84-e997-4f53-be04-f2c96db7048c None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.742956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57886b-d93e-4a1d-a3b6-3c32f151ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.743658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57886b-d93e-4a1d-a3b6-3c32f151ebbb None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.743955 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57886b-d93e-4a1d-a3b6-3c32f151ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.744397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57886b-d93e-4a1d-a3b6-3c32f151ebbb None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.744943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57886b-d93e-4a1d-a3b6-3c32f151ebbb None admin] RBAC: Adding query filter params (type=network) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:08.745253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57886b-d93e-4a1d-a3b6-3c32f151ebbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.746727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57886b-d93e-4a1d-a3b6-3c32f151ebbb None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.757976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 422/826] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:08.775649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57886b-d93e-4a1d-a3b6-3c32f151ebbb None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.796377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89a84-e997-4f53-be04-f2c96db7048c None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.832895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016188f2-ffc1-4e36-92be-0edf6ba9ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.834540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016188f2-ffc1-4e36-92be-0edf6ba9ec50 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.834957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016188f2-ffc1-4e36-92be-0edf6ba9ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.835356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016188f2-ffc1-4e36-92be-0edf6ba9ec50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.846412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016188f2-ffc1-4e36-92be-0edf6ba9ec50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.848074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016188f2-ffc1-4e36-92be-0edf6ba9ec50 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.865231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-016188f2-ffc1-4e36-92be-0edf6ba9ec50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:08.866977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 405/827] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:08.872104 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016188f2-ffc1-4e36-92be-0edf6ba9ec50 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:08.908818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57886b-d93e-4a1d-a3b6-3c32f151ebbb None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:08.945342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc4de4-9223-4347-bbf7-1ae4b648653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:08.946054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc4de4-9223-4347-bbf7-1ae4b648653a None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:08.946412 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc4de4-9223-4347-bbf7-1ae4b648653a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:08.946674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc4de4-9223-4347-bbf7-1ae4b648653a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:08.947387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc4de4-9223-4347-bbf7-1ae4b648653a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:08.948929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc4de4-9223-4347-bbf7-1ae4b648653a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:08.969064 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 423/828] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Mar 10 17:12:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:12:08.997431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016188f2-ffc1-4e36-92be-0edf6ba9ec50 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:09.043687 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5cc37-a2e3-413e-8852-d34f89e92cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:09.044621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5cc37-a2e3-413e-8852-d34f89e92cf7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:09.045048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5cc37-a2e3-413e-8852-d34f89e92cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:09.045485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5cc37-a2e3-413e-8852-d34f89e92cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:09.046656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5cc37-a2e3-413e-8852-d34f89e92cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:09.047370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5cc37-a2e3-413e-8852-d34f89e92cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:09.048908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5cc37-a2e3-413e-8852-d34f89e92cf7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:09.062801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 406/829] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:09.068086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc4de4-9223-4347-bbf7-1ae4b648653a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:09.180258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc4de4-9223-4347-bbf7-1ae4b648653a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:09.216757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b041dde-3962-4358-810e-17de628afa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:09.217851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041dde-3962-4358-810e-17de628afa73 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:09.218343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041dde-3962-4358-810e-17de628afa73 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:09.218817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041dde-3962-4358-810e-17de628afa73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:09.226385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b041dde-3962-4358-810e-17de628afa73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:09.228060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b041dde-3962-4358-810e-17de628afa73 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:09.242076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-7b041dde-3962-4358-810e-17de628afa73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:09.243513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 424/830] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:09.248987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5cc37-a2e3-413e-8852-d34f89e92cf7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:09.353857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5cc37-a2e3-413e-8852-d34f89e92cf7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:09.388576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486dbb0-91ff-446d-b95b-78b44ed2293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:09.389245 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486dbb0-91ff-446d-b95b-78b44ed2293a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:09.389532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486dbb0-91ff-446d-b95b-78b44ed2293a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:09.389808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486dbb0-91ff-446d-b95b-78b44ed2293a None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:09.390620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486dbb0-91ff-446d-b95b-78b44ed2293a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:09.390930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486dbb0-91ff-446d-b95b-78b44ed2293a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:09.392377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486dbb0-91ff-446d-b95b-78b44ed2293a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:09.404854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 407/831] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:09.410596 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b041dde-3962-4358-810e-17de628afa73 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:09.512145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b041dde-3962-4358-810e-17de628afa73 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:09.546599 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568f741-a552-4a48-921e-6f9358af142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:09.547503 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568f741-a552-4a48-921e-6f9358af142e None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:09.547782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568f741-a552-4a48-921e-6f9358af142e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:09.548057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568f741-a552-4a48-921e-6f9358af142e None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/e4f27325efd04f74b572def6a7060d9d/roles/f7e74696bb6d4f4e8571a49a6c5335c8` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:09.563355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568f741-a552-4a48-921e-6f9358af142e None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=e4f27325efd04f74b572def6a7060d9d, role_id=f7e74696bb6d4f4e8571a49a6c5335c8)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:09.564797 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568f741-a552-4a48-921e-6f9358af142e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:09.578898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 425/832] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:12:09 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/e4f27325efd04f74b572def6a7060d9d/roles/f7e74696bb6d4f4e8571a49a6c5335c8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:12:10.054432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e314f4-d2e3-403e-9b81-b391c568be20 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.055513 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e314f4-d2e3-403e-9b81-b391c568be20 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.055792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e314f4-d2e3-403e-9b81-b391c568be20 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.057671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 408/833] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:10.059142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d45d75-6698-4e21-82e2-50154d38a1b4 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.059558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d45d75-6698-4e21-82e2-50154d38a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.059723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d45d75-6698-4e21-82e2-50154d38a1b4 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.061697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 426/834] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:10.064532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dfdde-922b-4d99-b10b-30621f9dd988 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.064815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dfdde-922b-4d99-b10b-30621f9dd988 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.065086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dfdde-922b-4d99-b10b-30621f9dd988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.071334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408ef26-526b-4508-9d66-caa43c7e594a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.071629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408ef26-526b-4508-9d66-caa43c7e594a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.071913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408ef26-526b-4508-9d66-caa43c7e594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.081871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-cb0dfdde-922b-4d99-b10b-30621f9dd988 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:10.083895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cb0dfdde-922b-4d99-b10b-30621f9dd988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:10.089777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c408ef26-526b-4508-9d66-caa43c7e594a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:10.090991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c408ef26-526b-4508-9d66-caa43c7e594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:10.156928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 409/835] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:10.168791 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 427/836] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:10.181777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dfdde-922b-4d99-b10b-30621f9dd988 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:10.197238 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408ef26-526b-4508-9d66-caa43c7e594a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:10.305744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dfdde-922b-4d99-b10b-30621f9dd988 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:10.315946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408ef26-526b-4508-9d66-caa43c7e594a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:10.347337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7afc1-7c96-4da1-a302-53b4c412426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:10.348270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7afc1-7c96-4da1-a302-53b4c412426f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.348668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7afc1-7c96-4da1-a302-53b4c412426f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.349552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7afc1-7c96-4da1-a302-53b4c412426f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.350326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7afc1-7c96-4da1-a302-53b4c412426f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:10.351225 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269b7fd-2da9-4bad-a557-1ef9389e781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:10.351947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7afc1-7c96-4da1-a302-53b4c412426f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:10.352336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b7fd-2da9-4bad-a557-1ef9389e781b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.352765 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b7fd-2da9-4bad-a557-1ef9389e781b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.353184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b7fd-2da9-4bad-a557-1ef9389e781b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.363197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269b7fd-2da9-4bad-a557-1ef9389e781b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:10.365279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-c9c7afc1-7c96-4da1-a302-53b4c412426f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 10 17:12:10.371195 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-5269b7fd-2da9-4bad-a557-1ef9389e781b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:12:10.371446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 410/837] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:12:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:10.372378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7afc1-7c96-4da1-a302-53b4c412426f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:10.373288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 428/838] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:12:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:10.382132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269b7fd-2da9-4bad-a557-1ef9389e781b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:10.484194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7afc1-7c96-4da1-a302-53b4c412426f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:10.491762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269b7fd-2da9-4bad-a557-1ef9389e781b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:10.517870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb0c87-6fb7-4e20-81ad-b4ae896f94a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:10.518562 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb0c87-6fb7-4e20-81ad-b4ae896f94a6 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.518849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb0c87-6fb7-4e20-81ad-b4ae896f94a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.519127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb0c87-6fb7-4e20-81ad-b4ae896f94a6 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.519831 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb0c87-6fb7-4e20-81ad-b4ae896f94a6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:10.520138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb0c87-6fb7-4e20-81ad-b4ae896f94a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:10.521546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb0c87-6fb7-4e20-81ad-b4ae896f94a6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:10.526372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 411/839] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:12:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:10.531650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb0c87-6fb7-4e20-81ad-b4ae896f94a6 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:10.535344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba46cb-9c06-4b84-b548-0b2b73746009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:10.536967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba46cb-9c06-4b84-b548-0b2b73746009 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.536967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba46cb-9c06-4b84-b548-0b2b73746009 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.537152 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba46cb-9c06-4b84-b548-0b2b73746009 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.537844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba46cb-9c06-4b84-b548-0b2b73746009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:10.538180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba46cb-9c06-4b84-b548-0b2b73746009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:10.539540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba46cb-9c06-4b84-b548-0b2b73746009 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:10.553190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 429/840] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:12:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:10.554548 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba46cb-9c06-4b84-b548-0b2b73746009 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:10.647258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb0c87-6fb7-4e20-81ad-b4ae896f94a6 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:10.665162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba46cb-9c06-4b84-b548-0b2b73746009 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:10.680992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79534676-2642-4b16-b944-68c360125c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:10.681664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79534676-2642-4b16-b944-68c360125c73 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.681950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79534676-2642-4b16-b944-68c360125c73 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.682273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79534676-2642-4b16-b944-68c360125c73 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.682981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79534676-2642-4b16-b944-68c360125c73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:10.683287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79534676-2642-4b16-b944-68c360125c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:10.684670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79534676-2642-4b16-b944-68c360125c73 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:10.698140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 412/841] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:12:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:10.713922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847e97-c76a-4dfc-a87c-855dec85f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:10.714788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847e97-c76a-4dfc-a87c-855dec85f06d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.715071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847e97-c76a-4dfc-a87c-855dec85f06d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.715345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847e97-c76a-4dfc-a87c-855dec85f06d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.727568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c847e97-c76a-4dfc-a87c-855dec85f06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:10.729034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c847e97-c76a-4dfc-a87c-855dec85f06d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:10.747555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-8c847e97-c76a-4dfc-a87c-855dec85f06d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:10.749142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 430/842] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:10.754894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79534676-2642-4b16-b944-68c360125c73 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:10.862036 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79534676-2642-4b16-b944-68c360125c73 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:10.902316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eb646-efda-471b-9f02-e2ae8637d017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:10.903323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eb646-efda-471b-9f02-e2ae8637d017 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:10.903799 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eb646-efda-471b-9f02-e2ae8637d017 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:10.904288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eb646-efda-471b-9f02-e2ae8637d017 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:10.905210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eb646-efda-471b-9f02-e2ae8637d017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:10.905511 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eb646-efda-471b-9f02-e2ae8637d017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:10.907138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eb646-efda-471b-9f02-e2ae8637d017 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:10.919551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 413/843] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:10.925322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847e97-c76a-4dfc-a87c-855dec85f06d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:11.025850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847e97-c76a-4dfc-a87c-855dec85f06d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:11.068707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076713b-61de-44eb-9d0f-6d6d62253ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:11.070331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076713b-61de-44eb-9d0f-6d6d62253ecf None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:11.070819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076713b-61de-44eb-9d0f-6d6d62253ecf None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:11.071320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076713b-61de-44eb-9d0f-6d6d62253ecf None admin] PATH_INFO: `/v3/users/swift` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:11.080061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076713b-61de-44eb-9d0f-6d6d62253ecf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:11.081762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076713b-61de-44eb-9d0f-6d6d62253ecf None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:11.095544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-1076713b-61de-44eb-9d0f-6d6d62253ecf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 17:12:11.102173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 431/844] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:12:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:11.103790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eb646-efda-471b-9f02-e2ae8637d017 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:11.209297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eb646-efda-471b-9f02-e2ae8637d017 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:11.243480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f8a97-da0e-412c-a3bf-ae7e33ca9486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:11.244145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8a97-da0e-412c-a3bf-ae7e33ca9486 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:11.244424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8a97-da0e-412c-a3bf-ae7e33ca9486 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:11.244699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8a97-da0e-412c-a3bf-ae7e33ca9486 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:11.245525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f8a97-da0e-412c-a3bf-ae7e33ca9486 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:11.245826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f8a97-da0e-412c-a3bf-ae7e33ca9486 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:11.247296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f8a97-da0e-412c-a3bf-ae7e33ca9486 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:11.265286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 414/845] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Mar 10 17:12:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:11.271018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076713b-61de-44eb-9d0f-6d6d62253ecf None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:11.375858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076713b-61de-44eb-9d0f-6d6d62253ecf None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:11.391638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a90d2-4f92-4909-a9c9-64e2172645aa None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:11.391928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a90d2-4f92-4909-a9c9-64e2172645aa None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:11.392205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a90d2-4f92-4909-a9c9-64e2172645aa None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:11.394225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 415/846] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:11.403166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954aac-33ea-474a-bc2f-7f00a29cdd34 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:11.403448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954aac-33ea-474a-bc2f-7f00a29cdd34 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:11.403728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954aac-33ea-474a-bc2f-7f00a29cdd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:11.413598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920797d-43a6-4fdb-99a1-11e106842b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:11.414283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920797d-43a6-4fdb-99a1-11e106842b05 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:11.414571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920797d-43a6-4fdb-99a1-11e106842b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:11.414852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920797d-43a6-4fdb-99a1-11e106842b05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:11.422388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2f954aac-33ea-474a-bc2f-7f00a29cdd34 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:11.423977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2f954aac-33ea-474a-bc2f-7f00a29cdd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:11.499077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920797d-43a6-4fdb-99a1-11e106842b05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:11.501280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920797d-43a6-4fdb-99a1-11e106842b05 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:11.504960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 416/847] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:11.533222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954aac-33ea-474a-bc2f-7f00a29cdd34 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:11.606192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 432/848] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:12:11.607653 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920797d-43a6-4fdb-99a1-11e106842b05 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:11.651988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954aac-33ea-474a-bc2f-7f00a29cdd34 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:11.693853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369ac5-9358-471f-8672-3cb8cc7cc546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:11.694691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369ac5-9358-471f-8672-3cb8cc7cc546 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:11.694972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369ac5-9358-471f-8672-3cb8cc7cc546 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:11.695242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369ac5-9358-471f-8672-3cb8cc7cc546 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:11.695887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c369ac5-9358-471f-8672-3cb8cc7cc546 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:11.697266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c369ac5-9358-471f-8672-3cb8cc7cc546 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:11.709309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-6c369ac5-9358-471f-8672-3cb8cc7cc546 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 10 17:12:11.714216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 417/849] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Mar 10 17:12:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:11.716727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369ac5-9358-471f-8672-3cb8cc7cc546 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:11.729407 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920797d-43a6-4fdb-99a1-11e106842b05 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:11.772120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ce70c-fd61-4579-a0c7-276243fd82e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:11.773302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ce70c-fd61-4579-a0c7-276243fd82e9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:11.773594 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ce70c-fd61-4579-a0c7-276243fd82e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:11.773993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ce70c-fd61-4579-a0c7-276243fd82e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:11.787443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ce70c-fd61-4579-a0c7-276243fd82e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:11.788900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ce70c-fd61-4579-a0c7-276243fd82e9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:11.811883 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-6f8ce70c-fd61-4579-a0c7-276243fd82e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:11.813730 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 433/850] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:11.819119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ce70c-fd61-4579-a0c7-276243fd82e9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:11.822371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369ac5-9358-471f-8672-3cb8cc7cc546 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:11.865196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d7041-3788-4c9d-ae28-d396411c8f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:11.866287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7041-3788-4c9d-ae28-d396411c8f9b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:11.866791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7041-3788-4c9d-ae28-d396411c8f9b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:11.867258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7041-3788-4c9d-ae28-d396411c8f9b None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:11.868156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d7041-3788-4c9d-ae28-d396411c8f9b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:11.868656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d7041-3788-4c9d-ae28-d396411c8f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:11.870260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d7041-3788-4c9d-ae28-d396411c8f9b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:11.879643 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 418/851] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:11.881242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d7041-3788-4c9d-ae28-d396411c8f9b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:11.944077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ce70c-fd61-4579-a0c7-276243fd82e9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:11.985466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee52c6-4750-4ec9-8503-b5f5bf0af1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:11.986229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee52c6-4750-4ec9-8503-b5f5bf0af1e7 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:11.986568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee52c6-4750-4ec9-8503-b5f5bf0af1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:11.986850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee52c6-4750-4ec9-8503-b5f5bf0af1e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:11.987993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee52c6-4750-4ec9-8503-b5f5bf0af1e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:11.988307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee52c6-4750-4ec9-8503-b5f5bf0af1e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:11.990549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee52c6-4750-4ec9-8503-b5f5bf0af1e7 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:12.001604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d7041-3788-4c9d-ae28-d396411c8f9b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:12.006166 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 434/852] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:12.008988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cdead-1f17-452c-8895-6ac63ce92833 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.009278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cdead-1f17-452c-8895-6ac63ce92833 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.009555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cdead-1f17-452c-8895-6ac63ce92833 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.011400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 435/853] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:12.011965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cdead-1f17-452c-8895-6ac63ce92833 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:12.040648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9ae0b-e7c7-4594-9b8e-2405c02f72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:12.041265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9ae0b-e7c7-4594-9b8e-2405c02f72a0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.041506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9ae0b-e7c7-4594-9b8e-2405c02f72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.041781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9ae0b-e7c7-4594-9b8e-2405c02f72a0 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.042513 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9ae0b-e7c7-4594-9b8e-2405c02f72a0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:12.042816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9ae0b-e7c7-4594-9b8e-2405c02f72a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:12.044177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9ae0b-e7c7-4594-9b8e-2405c02f72a0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:12.054189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 419/854] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:12.054189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e0d4b-fa1e-48b3-94e4-5ef5dd71b3b0 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.054189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e0d4b-fa1e-48b3-94e4-5ef5dd71b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.054189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e0d4b-fa1e-48b3-94e4-5ef5dd71b3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.083999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2a4e0d4b-fa1e-48b3-94e4-5ef5dd71b3b0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:12.086043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2a4e0d4b-fa1e-48b3-94e4-5ef5dd71b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:12.134315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cdead-1f17-452c-8895-6ac63ce92833 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:12.179270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359550d-4520-4ed0-af9c-73e65820f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:12.179555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 420/855] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:12.180132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359550d-4520-4ed0-af9c-73e65820f6fc None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.180422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359550d-4520-4ed0-af9c-73e65820f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.180699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359550d-4520-4ed0-af9c-73e65820f6fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.192029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359550d-4520-4ed0-af9c-73e65820f6fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:12.193543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359550d-4520-4ed0-af9c-73e65820f6fc None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:12.205204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e0d4b-fa1e-48b3-94e4-5ef5dd71b3b0 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:12.209023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-8359550d-4520-4ed0-af9c-73e65820f6fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:12.210649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 436/856] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:12.216218 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359550d-4520-4ed0-af9c-73e65820f6fc None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:12.324795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e0d4b-fa1e-48b3-94e4-5ef5dd71b3b0 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:12.332331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359550d-4520-4ed0-af9c-73e65820f6fc None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:12.361120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb29e16-05d7-4000-9570-a17ce10d70e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:12.362311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29e16-05d7-4000-9570-a17ce10d70e1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.362813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29e16-05d7-4000-9570-a17ce10d70e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.363328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29e16-05d7-4000-9570-a17ce10d70e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.374508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb29e16-05d7-4000-9570-a17ce10d70e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:12.374683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12482f-9812-45ea-bcc3-84f6c5d9f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:12.375343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12482f-9812-45ea-bcc3-84f6c5d9f90c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.375626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12482f-9812-45ea-bcc3-84f6c5d9f90c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.375903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12482f-9812-45ea-bcc3-84f6c5d9f90c None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.376690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12482f-9812-45ea-bcc3-84f6c5d9f90c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:12.376996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12482f-9812-45ea-bcc3-84f6c5d9f90c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:12.378458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12482f-9812-45ea-bcc3-84f6c5d9f90c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:12.384020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-8cb29e16-05d7-4000-9570-a17ce10d70e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:12:12.390238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 421/857] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:12.391306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb29e16-05d7-4000-9570-a17ce10d70e1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:12.392265 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 437/858] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:12.398496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12482f-9812-45ea-bcc3-84f6c5d9f90c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:12.511707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb29e16-05d7-4000-9570-a17ce10d70e1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:12.517736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12482f-9812-45ea-bcc3-84f6c5d9f90c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:12.551750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31feef37-449c-4a88-988c-4d31ae9d9ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:12.553316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feef37-449c-4a88-988c-4d31ae9d9ada None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.553437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaf3bd-3692-4f54-994b-dfc5357ce630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:12.553936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feef37-449c-4a88-988c-4d31ae9d9ada None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.554143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaf3bd-3692-4f54-994b-dfc5357ce630 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.554429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaf3bd-3692-4f54-994b-dfc5357ce630 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.554705 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaf3bd-3692-4f54-994b-dfc5357ce630 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.555051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feef37-449c-4a88-988c-4d31ae9d9ada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.555453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaf3bd-3692-4f54-994b-dfc5357ce630 None admin] RBAC: Adding query filter params (name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:12.555758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaf3bd-3692-4f54-994b-dfc5357ce630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:12.556653 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31feef37-449c-4a88-988c-4d31ae9d9ada None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=35cc9fe9f62844a38f78d52435186f26) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:12.557181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaf3bd-3692-4f54-994b-dfc5357ce630 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:12.557431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31feef37-449c-4a88-988c-4d31ae9d9ada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:12.559077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31feef37-449c-4a88-988c-4d31ae9d9ada None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:12.570158 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 422/859] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:12.570355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 438/860] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:12 2022] GET /identity/v3/role_assignments?user.id=35cc9fe9f62844a38f78d52435186f26&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:12.574144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaf3bd-3692-4f54-994b-dfc5357ce630 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:12.680808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaf3bd-3692-4f54-994b-dfc5357ce630 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:12.716377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d88775-d461-4583-876a-1d8a3cae3ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:12.717182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d88775-d461-4583-876a-1d8a3cae3ece None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.717469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d88775-d461-4583-876a-1d8a3cae3ece None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.717743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d88775-d461-4583-876a-1d8a3cae3ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.729850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d88775-d461-4583-876a-1d8a3cae3ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:12.731359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d88775-d461-4583-876a-1d8a3cae3ece None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:12.749743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-76d88775-d461-4583-876a-1d8a3cae3ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:12.751395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 423/861] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:12.757168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31feef37-449c-4a88-988c-4d31ae9d9ada None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:12.862724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31feef37-449c-4a88-988c-4d31ae9d9ada None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:12.896558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305159c9-85dc-48f9-aee8-dd03b6eddf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:12.897236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305159c9-85dc-48f9-aee8-dd03b6eddf21 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:12.897519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305159c9-85dc-48f9-aee8-dd03b6eddf21 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:12.897792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305159c9-85dc-48f9-aee8-dd03b6eddf21 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:12.898541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305159c9-85dc-48f9-aee8-dd03b6eddf21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:12.898847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305159c9-85dc-48f9-aee8-dd03b6eddf21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:12.900199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305159c9-85dc-48f9-aee8-dd03b6eddf21 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:12.914702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 439/862] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:12.920154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d88775-d461-4583-876a-1d8a3cae3ece None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:13.025337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d88775-d461-4583-876a-1d8a3cae3ece None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:13.058496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f1010-72b6-424d-9159-356c7e21293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:13.059305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1010-72b6-424d-9159-356c7e21293f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:13.059586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1010-72b6-424d-9159-356c7e21293f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:13.059860 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1010-72b6-424d-9159-356c7e21293f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:13.067350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f1010-72b6-424d-9159-356c7e21293f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:13.068809 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f1010-72b6-424d-9159-356c7e21293f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:13.082475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-004f1010-72b6-424d-9159-356c7e21293f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 17:12:13.084509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 424/863] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:12:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:13.090372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305159c9-85dc-48f9-aee8-dd03b6eddf21 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:13.127546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f1f4-06f7-43ef-a73e-88d41e50cef9 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:13.128149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f1f4-06f7-43ef-a73e-88d41e50cef9 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:13.128629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f1f4-06f7-43ef-a73e-88d41e50cef9 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:13.130916 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 425/864] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:13.135876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e4f5-91c9-4c2b-af4d-f5b7aeda1e6c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:13.136415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e4f5-91c9-4c2b-af4d-f5b7aeda1e6c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:13.136894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e4f5-91c9-4c2b-af4d-f5b7aeda1e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:13.156021 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-4483e4f5-91c9-4c2b-af4d-f5b7aeda1e6c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:13.158139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-4483e4f5-91c9-4c2b-af4d-f5b7aeda1e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:13.202929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305159c9-85dc-48f9-aee8-dd03b6eddf21 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:13.246180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 426/865] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:13.248543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38853c72-abae-4eae-b32f-94b21ec4a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:13.249478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38853c72-abae-4eae-b32f-94b21ec4a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:13.249913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38853c72-abae-4eae-b32f-94b21ec4a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:13.250399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38853c72-abae-4eae-b32f-94b21ec4a8f9 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:13.251395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38853c72-abae-4eae-b32f-94b21ec4a8f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:13.251874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38853c72-abae-4eae-b32f-94b21ec4a8f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:13.253509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38853c72-abae-4eae-b32f-94b21ec4a8f9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:13.266454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e4f5-91c9-4c2b-af4d-f5b7aeda1e6c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:13.273949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 440/866] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Mar 10 17:12:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:13.278981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38853c72-abae-4eae-b32f-94b21ec4a8f9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:13.400540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e4f5-91c9-4c2b-af4d-f5b7aeda1e6c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:13.402613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38853c72-abae-4eae-b32f-94b21ec4a8f9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:13.439987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56ea06-3cf4-436b-8320-4193b702007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:13.440648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56ea06-3cf4-436b-8320-4193b702007e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:13.440891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b793-df3a-4d2e-811a-4d5be727eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:13.441014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56ea06-3cf4-436b-8320-4193b702007e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:13.441196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56ea06-3cf4-436b-8320-4193b702007e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:13.442048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b793-df3a-4d2e-811a-4d5be727eaec None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:13.442587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b793-df3a-4d2e-811a-4d5be727eaec None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:13.443058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b793-df3a-4d2e-811a-4d5be727eaec None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:13.443986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b793-df3a-4d2e-811a-4d5be727eaec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:13.445565 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b793-df3a-4d2e-811a-4d5be727eaec None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:13.459862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 427/867] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:12:13 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:12:13.516247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56ea06-3cf4-436b-8320-4193b702007e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:13.517753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56ea06-3cf4-436b-8320-4193b702007e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:13.623979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 441/868] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 10 17:12:13.629578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b793-df3a-4d2e-811a-4d5be727eaec None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:13.750569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b793-df3a-4d2e-811a-4d5be727eaec None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:13.787644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806dde1-ade5-4baa-b963-81f39e078d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:13.788437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806dde1-ade5-4baa-b963-81f39e078d38 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:13.788716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806dde1-ade5-4baa-b963-81f39e078d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:13.788990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806dde1-ade5-4baa-b963-81f39e078d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:13.800309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806dde1-ade5-4baa-b963-81f39e078d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:13.802377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806dde1-ade5-4baa-b963-81f39e078d38 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:13.820951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-7806dde1-ade5-4baa-b963-81f39e078d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:13.822511 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 428/869] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:13.827745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56ea06-3cf4-436b-8320-4193b702007e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:13.926001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56ea06-3cf4-436b-8320-4193b702007e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:13.959632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eef535-2b4a-4086-98ec-79feb0716d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:13.960301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eef535-2b4a-4086-98ec-79feb0716d8f None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:13.960587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eef535-2b4a-4086-98ec-79feb0716d8f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:13.960866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eef535-2b4a-4086-98ec-79feb0716d8f None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:13.961580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eef535-2b4a-4086-98ec-79feb0716d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:13.961886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eef535-2b4a-4086-98ec-79feb0716d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:13.963284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eef535-2b4a-4086-98ec-79feb0716d8f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:13.975256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 442/870] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:13.980664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806dde1-ade5-4baa-b963-81f39e078d38 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:14.084862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806dde1-ade5-4baa-b963-81f39e078d38 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:14.119918 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa38ac-6542-43d2-8cac-641a13720f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:14.120708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa38ac-6542-43d2-8cac-641a13720f9c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:14.120989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa38ac-6542-43d2-8cac-641a13720f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:14.121261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa38ac-6542-43d2-8cac-641a13720f9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:14.128004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa38ac-6542-43d2-8cac-641a13720f9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:14.129443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa38ac-6542-43d2-8cac-641a13720f9c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:14.143302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-a5fa38ac-6542-43d2-8cac-641a13720f9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:14.144763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 429/871] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:14.150892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eef535-2b4a-4086-98ec-79feb0716d8f None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:14.249502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eef535-2b4a-4086-98ec-79feb0716d8f None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:14.286993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570df67-2cae-41ec-82d2-901b0eb5f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:14.288029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570df67-2cae-41ec-82d2-901b0eb5f560 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:14.288519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570df67-2cae-41ec-82d2-901b0eb5f560 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:14.289015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570df67-2cae-41ec-82d2-901b0eb5f560 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:14.290027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570df67-2cae-41ec-82d2-901b0eb5f560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:14.290636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570df67-2cae-41ec-82d2-901b0eb5f560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:14.292337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570df67-2cae-41ec-82d2-901b0eb5f560 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:14.305822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 443/872] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:14.315188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa38ac-6542-43d2-8cac-641a13720f9c None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:14.417977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa38ac-6542-43d2-8cac-641a13720f9c None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:14.452045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4018213-17ab-48ba-990f-772b65e0843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:14.452699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4018213-17ab-48ba-990f-772b65e0843b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:14.452979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4018213-17ab-48ba-990f-772b65e0843b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:14.453252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4018213-17ab-48ba-990f-772b65e0843b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:14.454072 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4018213-17ab-48ba-990f-772b65e0843b None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=e4f27325efd04f74b572def6a7060d9d) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:14.454405 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4018213-17ab-48ba-990f-772b65e0843b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:14.455819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4018213-17ab-48ba-990f-772b65e0843b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:14.462431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9458-e7c1-4d21-aabd-8455c1cfa94e None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:14.462666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 430/873] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:14 2022] GET /identity/v3/role_assignments?user.id=e4f27325efd04f74b572def6a7060d9d&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:14.462774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9458-e7c1-4d21-aabd-8455c1cfa94e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:14.462996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9458-e7c1-4d21-aabd-8455c1cfa94e None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:14.464840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 444/874] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:14.472031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f49ea-a0b6-4df6-83f9-4cc097215ef6 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:14.472370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f49ea-a0b6-4df6-83f9-4cc097215ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:14.472593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f49ea-a0b6-4df6-83f9-4cc097215ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:14.491388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-6b9f49ea-a0b6-4df6-83f9-4cc097215ef6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:14.492593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6b9f49ea-a0b6-4df6-83f9-4cc097215ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:14.569218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 431/875] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:14.592116 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9458-e7c1-4d21-aabd-8455c1cfa94e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:14.705183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9458-e7c1-4d21-aabd-8455c1cfa94e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:14.743370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3c0bf-71c5-46fe-bdb8-a08394345c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:14.744279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3c0bf-71c5-46fe-bdb8-a08394345c23 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:14.744750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3c0bf-71c5-46fe-bdb8-a08394345c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:14.745034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3c0bf-71c5-46fe-bdb8-a08394345c23 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:14.745763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3c0bf-71c5-46fe-bdb8-a08394345c23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:14.747179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3c0bf-71c5-46fe-bdb8-a08394345c23 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:14.762854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 445/876] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:12:14 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:12:15.061076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0a56-e828-4e2e-990e-9a6bc396e3a4 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:15.061480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0a56-e828-4e2e-990e-9a6bc396e3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:15.061669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0a56-e828-4e2e-990e-9a6bc396e3a4 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:15.063719 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 432/877] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:15.068989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcf9ca-a423-4c9c-bffe-f673527943d0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:15.069284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcf9ca-a423-4c9c-bffe-f673527943d0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:15.069570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcf9ca-a423-4c9c-bffe-f673527943d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:15.087007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-44fcf9ca-a423-4c9c-bffe-f673527943d0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:15.088178 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-44fcf9ca-a423-4c9c-bffe-f673527943d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:15.160779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 446/878] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:15.185212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa0a56-e828-4e2e-990e-9a6bc396e3a4 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:15.284730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa0a56-e828-4e2e-990e-9a6bc396e3a4 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:15.321278 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2e28-65de-4a5b-a254-de856ba4c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:15.322025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2e28-65de-4a5b-a254-de856ba4c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:15.322331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2e28-65de-4a5b-a254-de856ba4c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:15.322598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2e28-65de-4a5b-a254-de856ba4c0e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:15.323244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e2e28-65de-4a5b-a254-de856ba4c0e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:15.324600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e2e28-65de-4a5b-a254-de856ba4c0e2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:15.336359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-771e2e28-65de-4a5b-a254-de856ba4c0e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 17:12:15.337827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 433/879] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:15.343947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcf9ca-a423-4c9c-bffe-f673527943d0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:15.447601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcf9ca-a423-4c9c-bffe-f673527943d0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:15.485722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a83441-2f53-4290-a103-081dd010cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:15.486416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83441-2f53-4290-a103-081dd010cb73 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:15.486699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83441-2f53-4290-a103-081dd010cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:15.486969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83441-2f53-4290-a103-081dd010cb73 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:15.487662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83441-2f53-4290-a103-081dd010cb73 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:15.487962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83441-2f53-4290-a103-081dd010cb73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:15.489333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83441-2f53-4290-a103-081dd010cb73 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:15.494208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 447/880] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:15.503185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2e28-65de-4a5b-a254-de856ba4c0e2 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:15.610550 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2e28-65de-4a5b-a254-de856ba4c0e2 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:15.649401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a42f1b-672d-40e7-bc3a-cdf070967e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:15.650059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a42f1b-672d-40e7-bc3a-cdf070967e1d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:15.650365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a42f1b-672d-40e7-bc3a-cdf070967e1d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:15.650636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a42f1b-672d-40e7-bc3a-cdf070967e1d None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:15.651334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a42f1b-672d-40e7-bc3a-cdf070967e1d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:15.651633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a42f1b-672d-40e7-bc3a-cdf070967e1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:15.652977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a42f1b-672d-40e7-bc3a-cdf070967e1d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:15.657691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 434/881] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:15.935674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a995ec5-869b-4b40-8586-3e668e36abc8 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:15.936023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a995ec5-869b-4b40-8586-3e668e36abc8 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:15.936206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a995ec5-869b-4b40-8586-3e668e36abc8 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:15.938173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 448/882] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:15.944053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03b8bc-21f1-48f0-acb2-1ec234f067d6 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:15.944343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03b8bc-21f1-48f0-acb2-1ec234f067d6 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:15.944622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03b8bc-21f1-48f0-acb2-1ec234f067d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:15.962555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1b03b8bc-21f1-48f0-acb2-1ec234f067d6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:15.963752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1b03b8bc-21f1-48f0-acb2-1ec234f067d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:16.029909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 435/883] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:16.052764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a995ec5-869b-4b40-8586-3e668e36abc8 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:16.151412 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a995ec5-869b-4b40-8586-3e668e36abc8 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:16.184298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233dab3-0138-427f-adc2-32163bfd2960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:16.185097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233dab3-0138-427f-adc2-32163bfd2960 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:16.185378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233dab3-0138-427f-adc2-32163bfd2960 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:16.185649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233dab3-0138-427f-adc2-32163bfd2960 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:16.186380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233dab3-0138-427f-adc2-32163bfd2960 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:16.187679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233dab3-0138-427f-adc2-32163bfd2960 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:16.198722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-2233dab3-0138-427f-adc2-32163bfd2960 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 10 17:12:16.200428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 449/884] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:12:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:16.206379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03b8bc-21f1-48f0-acb2-1ec234f067d6 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:16.304778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03b8bc-21f1-48f0-acb2-1ec234f067d6 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:16.338893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824052-a948-4f55-9d20-bb75057449e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:16.339639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824052-a948-4f55-9d20-bb75057449e0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:16.339831 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824052-a948-4f55-9d20-bb75057449e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:16.340093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824052-a948-4f55-9d20-bb75057449e0 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:16.340789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5824052-a948-4f55-9d20-bb75057449e0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:16.341091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5824052-a948-4f55-9d20-bb75057449e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:16.342468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5824052-a948-4f55-9d20-bb75057449e0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:16.347356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 436/885] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:12:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:16.352870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233dab3-0138-427f-adc2-32163bfd2960 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:16.451543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233dab3-0138-427f-adc2-32163bfd2960 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:16.484657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cecfc0-f541-4a7c-9688-2294a1ce309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:16.485321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cecfc0-f541-4a7c-9688-2294a1ce309b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:16.485600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cecfc0-f541-4a7c-9688-2294a1ce309b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:16.485871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cecfc0-f541-4a7c-9688-2294a1ce309b None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:16.486606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cecfc0-f541-4a7c-9688-2294a1ce309b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:16.486908 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cecfc0-f541-4a7c-9688-2294a1ce309b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:16.488256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cecfc0-f541-4a7c-9688-2294a1ce309b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:16.493433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 450/886] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:12:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:16.499444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824052-a948-4f55-9d20-bb75057449e0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:16.597345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824052-a948-4f55-9d20-bb75057449e0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:16.635030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb1211-fca2-41ec-b35c-9a2223e1319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:16.635699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb1211-fca2-41ec-b35c-9a2223e1319a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:16.635979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb1211-fca2-41ec-b35c-9a2223e1319a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:16.636251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb1211-fca2-41ec-b35c-9a2223e1319a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:16.637048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb1211-fca2-41ec-b35c-9a2223e1319a None admin] RBAC: Adding query filter params (interface=public, service_id=cd05740c2c5b4d27a1f9b684b09aa2a1, region_id=RegionOne) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:16.637350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb1211-fca2-41ec-b35c-9a2223e1319a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:16.638741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb1211-fca2-41ec-b35c-9a2223e1319a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:16.647396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 437/887] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Mar 10 17:12:16 2022] GET /identity/v3/endpoints?service_id=cd05740c2c5b4d27a1f9b684b09aa2a1&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:16.652760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cecfc0-f541-4a7c-9688-2294a1ce309b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:16.752048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cecfc0-f541-4a7c-9688-2294a1ce309b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:16.785070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac488b7d-df13-4e8c-a856-b21d5f5e425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:16.785752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac488b7d-df13-4e8c-a856-b21d5f5e425a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:16.786734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac488b7d-df13-4e8c-a856-b21d5f5e425a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:16.787078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac488b7d-df13-4e8c-a856-b21d5f5e425a None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:16.787780 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac488b7d-df13-4e8c-a856-b21d5f5e425a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:16.789191 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac488b7d-df13-4e8c-a856-b21d5f5e425a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:16.796219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 451/888] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Mar 10 17:12:16 2022] GET /identity/v3/services => generated 1268 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:12:16.985710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674662-eea0-47cc-b31e-38feef059bb1 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:16.986091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674662-eea0-47cc-b31e-38feef059bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:16.986310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674662-eea0-47cc-b31e-38feef059bb1 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:16.988340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 438/889] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:16.993489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb80ba-7b66-454f-a94e-5efb0537f3d9 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:16.993790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb80ba-7b66-454f-a94e-5efb0537f3d9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:16.994077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb80ba-7b66-454f-a94e-5efb0537f3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.011786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0fcb80ba-7b66-454f-a94e-5efb0537f3d9 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:17.012908 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0fcb80ba-7b66-454f-a94e-5efb0537f3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:17.079183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 452/890] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:17.103125 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674662-eea0-47cc-b31e-38feef059bb1 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.173208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e8d5b-9f83-4fb0-9418-f236380e5130 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.174338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e8d5b-9f83-4fb0-9418-f236380e5130 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.174623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e8d5b-9f83-4fb0-9418-f236380e5130 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.176690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 453/891] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:17.182130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac35a4-157a-4680-b002-d2f52374a20b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.183985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac35a4-157a-4680-b002-d2f52374a20b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.184183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac35a4-157a-4680-b002-d2f52374a20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.206316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-caac35a4-157a-4680-b002-d2f52374a20b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:17.207714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-caac35a4-157a-4680-b002-d2f52374a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:17.208876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674662-eea0-47cc-b31e-38feef059bb1 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:17.248540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b3e82-f4a5-4c04-94ea-690e3a23079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:17.250160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b3e82-f4a5-4c04-94ea-690e3a23079e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.250449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b3e82-f4a5-4c04-94ea-690e3a23079e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.250723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b3e82-f4a5-4c04-94ea-690e3a23079e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.263406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b3e82-f4a5-4c04-94ea-690e3a23079e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:17.273450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-ce6b3e82-f4a5-4c04-94ea-690e3a23079e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 17:12:17.275412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 439/892] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:17.283373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b3e82-f4a5-4c04-94ea-690e3a23079e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.286986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 454/893] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:17.322764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac35a4-157a-4680-b002-d2f52374a20b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.390883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b3e82-f4a5-4c04-94ea-690e3a23079e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:17.424689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a028901-b84f-4466-87fa-a7f6cab38d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:17.425272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac35a4-157a-4680-b002-d2f52374a20b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:17.425727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a028901-b84f-4466-87fa-a7f6cab38d3d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.425727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a028901-b84f-4466-87fa-a7f6cab38d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.425902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a028901-b84f-4466-87fa-a7f6cab38d3d None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.427191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a028901-b84f-4466-87fa-a7f6cab38d3d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:17.427502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a028901-b84f-4466-87fa-a7f6cab38d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:17.428881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a028901-b84f-4466-87fa-a7f6cab38d3d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:17.441593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 440/894] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:17.443283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a028901-b84f-4466-87fa-a7f6cab38d3d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.461977 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d936fbe-459a-48fd-a251-56f36e1a5fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:17.462886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d936fbe-459a-48fd-a251-56f36e1a5fcf None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.463168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d936fbe-459a-48fd-a251-56f36e1a5fcf None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.463444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d936fbe-459a-48fd-a251-56f36e1a5fcf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.464093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d936fbe-459a-48fd-a251-56f36e1a5fcf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:17.465452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d936fbe-459a-48fd-a251-56f36e1a5fcf None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:17.477217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-3d936fbe-459a-48fd-a251-56f36e1a5fcf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 10 17:12:17.483474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 455/895] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:17.484792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d936fbe-459a-48fd-a251-56f36e1a5fcf None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.552958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a028901-b84f-4466-87fa-a7f6cab38d3d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:17.587709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397331-09b5-4888-8cfe-a346f4a28632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:17.587925 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d936fbe-459a-48fd-a251-56f36e1a5fcf None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:17.588857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397331-09b5-4888-8cfe-a346f4a28632 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.589311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397331-09b5-4888-8cfe-a346f4a28632 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.589730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397331-09b5-4888-8cfe-a346f4a28632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.601556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5397331-09b5-4888-8cfe-a346f4a28632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:17.603326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5397331-09b5-4888-8cfe-a346f4a28632 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:17.621168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-e5397331-09b5-4888-8cfe-a346f4a28632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:17.627433 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 441/896] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:17.628652 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046721d3-226b-428e-a8cb-b023924c8746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:17.629016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397331-09b5-4888-8cfe-a346f4a28632 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.629388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046721d3-226b-428e-a8cb-b023924c8746 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.629699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046721d3-226b-428e-a8cb-b023924c8746 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.630602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046721d3-226b-428e-a8cb-b023924c8746 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.631372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046721d3-226b-428e-a8cb-b023924c8746 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:17.631685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046721d3-226b-428e-a8cb-b023924c8746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:17.633520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046721d3-226b-428e-a8cb-b023924c8746 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:17.643682 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 456/897] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:17.644736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046721d3-226b-428e-a8cb-b023924c8746 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.735201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397331-09b5-4888-8cfe-a346f4a28632 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:17.749848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046721d3-226b-428e-a8cb-b023924c8746 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:17.769505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e3ff5-1844-4026-be91-8210aebddf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:17.770494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e3ff5-1844-4026-be91-8210aebddf4f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.771014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e3ff5-1844-4026-be91-8210aebddf4f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.771493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e3ff5-1844-4026-be91-8210aebddf4f None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.772408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e3ff5-1844-4026-be91-8210aebddf4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:17.772929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e3ff5-1844-4026-be91-8210aebddf4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:17.774535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e3ff5-1844-4026-be91-8210aebddf4f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:17.782806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f56ae6-f6cb-494e-9149-6ea5c4ab8277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:17.783468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f56ae6-f6cb-494e-9149-6ea5c4ab8277 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.783752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f56ae6-f6cb-494e-9149-6ea5c4ab8277 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.784030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f56ae6-f6cb-494e-9149-6ea5c4ab8277 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.784729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f56ae6-f6cb-494e-9149-6ea5c4ab8277 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:17.785034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f56ae6-f6cb-494e-9149-6ea5c4ab8277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:17.787106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f56ae6-f6cb-494e-9149-6ea5c4ab8277 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:17.794348 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 442/898] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:17.796207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e3ff5-1844-4026-be91-8210aebddf4f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.796621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 457/899] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:17.798325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f56ae6-f6cb-494e-9149-6ea5c4ab8277 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.899486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e3ff5-1844-4026-be91-8210aebddf4f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:17.899675 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f56ae6-f6cb-494e-9149-6ea5c4ab8277 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:17.934564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe96f3-3d09-4eb5-9f0f-04ed270165f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:17.935228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe96f3-3d09-4eb5-9f0f-04ed270165f5 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.935513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe96f3-3d09-4eb5-9f0f-04ed270165f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.935800 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe96f3-3d09-4eb5-9f0f-04ed270165f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.936857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe96f3-3d09-4eb5-9f0f-04ed270165f5 None admin] RBAC: Adding query filter params (interface=public, service_id=2028e35534ee42a984679921737c73e4, region_id=RegionOne) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:17.937177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe96f3-3d09-4eb5-9f0f-04ed270165f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:17.938457 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd51a7-87e0-4926-87b3-58058eaf6667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:17.938598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe96f3-3d09-4eb5-9f0f-04ed270165f5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:17.939606 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd51a7-87e0-4926-87b3-58058eaf6667 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:17.940106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd51a7-87e0-4926-87b3-58058eaf6667 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:17.940579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd51a7-87e0-4926-87b3-58058eaf6667 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:17.948444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd51a7-87e0-4926-87b3-58058eaf6667 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:17.948636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 458/900] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/endpoints?service_id=2028e35534ee42a984679921737c73e4&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:17.949554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe96f3-3d09-4eb5-9f0f-04ed270165f5 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:17.950689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd51a7-87e0-4926-87b3-58058eaf6667 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:17.966262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-7bdd51a7-87e0-4926-87b3-58058eaf6667 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 17:12:17.972657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 443/901] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:17.974426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd51a7-87e0-4926-87b3-58058eaf6667 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:18.051194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe96f3-3d09-4eb5-9f0f-04ed270165f5 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:18.074608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd51a7-87e0-4926-87b3-58058eaf6667 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:18.084108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d8f0d-7767-44cc-adea-a398b988a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:18.084777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d8f0d-7767-44cc-adea-a398b988a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:18.085118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d8f0d-7767-44cc-adea-a398b988a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:18.085405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d8f0d-7767-44cc-adea-a398b988a2c3 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:18.086082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d8f0d-7767-44cc-adea-a398b988a2c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:18.087483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d8f0d-7767-44cc-adea-a398b988a2c3 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:18.094528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 459/902] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:12:18.094528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31e9d5-8dbe-4df5-959f-fe1006ff8764 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:18.094528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31e9d5-8dbe-4df5-959f-fe1006ff8764 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:18.094823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31e9d5-8dbe-4df5-959f-fe1006ff8764 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:18.096583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 460/903] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:18.102709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6745-aea4-4fee-becb-f621e7d58eca None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:18.102954 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6745-aea4-4fee-becb-f621e7d58eca None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:18.103523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6745-aea4-4fee-becb-f621e7d58eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:18.115879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40626c5-ce8e-4c18-96cc-390dc67d7f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:18.116936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40626c5-ce8e-4c18-96cc-390dc67d7f60 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:18.117402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40626c5-ce8e-4c18-96cc-390dc67d7f60 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:18.117885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40626c5-ce8e-4c18-96cc-390dc67d7f60 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:18.119007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40626c5-ce8e-4c18-96cc-390dc67d7f60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:18.119588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40626c5-ce8e-4c18-96cc-390dc67d7f60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:18.121330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40626c5-ce8e-4c18-96cc-390dc67d7f60 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:18.123678 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-524f6745-aea4-4fee-becb-f621e7d58eca None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:18.125450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-524f6745-aea4-4fee-becb-f621e7d58eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:18.142403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 444/904] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Mar 10 17:12:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:18.148702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40626c5-ce8e-4c18-96cc-390dc67d7f60 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:18.222580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 461/905] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:18.238420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6745-aea4-4fee-becb-f621e7d58eca None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:18.259291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40626c5-ce8e-4c18-96cc-390dc67d7f60 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:18.299096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5555b-799e-4d72-8e87-d7d43137ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:18.299873 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5555b-799e-4d72-8e87-d7d43137ca4c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:18.300152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5555b-799e-4d72-8e87-d7d43137ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:18.300444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5555b-799e-4d72-8e87-d7d43137ca4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:18.375013 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6745-aea4-4fee-becb-f621e7d58eca None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:18.383474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5555b-799e-4d72-8e87-d7d43137ca4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:18.385255 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5555b-799e-4d72-8e87-d7d43137ca4c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:18.418737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938579-fbd3-43e8-8bcc-d1c9ce2da79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:18.419416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938579-fbd3-43e8-8bcc-d1c9ce2da79f None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:18.419701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938579-fbd3-43e8-8bcc-d1c9ce2da79f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:18.419979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938579-fbd3-43e8-8bcc-d1c9ce2da79f None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:18.420852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938579-fbd3-43e8-8bcc-d1c9ce2da79f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:18.423333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938579-fbd3-43e8-8bcc-d1c9ce2da79f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:18.439308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 462/906] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:12:18 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:12:18.506237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 445/907] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:18 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:12:18.509609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938579-fbd3-43e8-8bcc-d1c9ce2da79f None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:18.625923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938579-fbd3-43e8-8bcc-d1c9ce2da79f None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:18.663384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f853534-3e46-4450-9e65-ba645081b5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:18.664224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f853534-3e46-4450-9e65-ba645081b5d8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:18.664468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f853534-3e46-4450-9e65-ba645081b5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:18.664745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f853534-3e46-4450-9e65-ba645081b5d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:18.675510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f853534-3e46-4450-9e65-ba645081b5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:18.676985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f853534-3e46-4450-9e65-ba645081b5d8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:18.693795 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-3f853534-3e46-4450-9e65-ba645081b5d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:18.695349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 463/908] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:18.700728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5555b-799e-4d72-8e87-d7d43137ca4c None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:18.802623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5555b-799e-4d72-8e87-d7d43137ca4c None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:18.838599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e30edd-7a1e-49f2-873f-39958b694ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:18.839269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e30edd-7a1e-49f2-873f-39958b694ab8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:18.839552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e30edd-7a1e-49f2-873f-39958b694ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:18.839830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e30edd-7a1e-49f2-873f-39958b694ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:18.840550 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e30edd-7a1e-49f2-873f-39958b694ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:18.840855 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e30edd-7a1e-49f2-873f-39958b694ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:18.842245 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e30edd-7a1e-49f2-873f-39958b694ab8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:18.854199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 446/909] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:18.859355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f853534-3e46-4450-9e65-ba645081b5d8 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:18.962473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f853534-3e46-4450-9e65-ba645081b5d8 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:18.996093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897f25f-9790-45af-a9a4-700c117b0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:18.996902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897f25f-9790-45af-a9a4-700c117b0c3e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:18.997191 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897f25f-9790-45af-a9a4-700c117b0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:18.997470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897f25f-9790-45af-a9a4-700c117b0c3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:19.004329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897f25f-9790-45af-a9a4-700c117b0c3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:19.005804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897f25f-9790-45af-a9a4-700c117b0c3e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:19.019657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-f897f25f-9790-45af-a9a4-700c117b0c3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:19.021676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 464/910] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:19.027301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e30edd-7a1e-49f2-873f-39958b694ab8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:19.131439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e30edd-7a1e-49f2-873f-39958b694ab8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:19.143850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a8b06-a70c-4af7-986b-1486bc7407df None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:19.144133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a8b06-a70c-4af7-986b-1486bc7407df None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:19.144410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a8b06-a70c-4af7-986b-1486bc7407df None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:19.147015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 465/911] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:19.155107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a607ec0-0233-4dab-bf43-c1b736c4790b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:19.155635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a607ec0-0233-4dab-bf43-c1b736c4790b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:19.156127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a607ec0-0233-4dab-bf43-c1b736c4790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:19.173333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81c05f-7cb0-478e-ad76-23d3c930c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:19.174000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81c05f-7cb0-478e-ad76-23d3c930c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:19.174316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81c05f-7cb0-478e-ad76-23d3c930c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:19.174597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81c05f-7cb0-478e-ad76-23d3c930c3d2 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:19.175396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81c05f-7cb0-478e-ad76-23d3c930c3d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:19.175710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81c05f-7cb0-478e-ad76-23d3c930c3d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:19.177324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81c05f-7cb0-478e-ad76-23d3c930c3d2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:19.177894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4a607ec0-0233-4dab-bf43-c1b736c4790b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:19.179480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4a607ec0-0233-4dab-bf43-c1b736c4790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:19.194275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 447/912] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:19.198056 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81c05f-7cb0-478e-ad76-23d3c930c3d2 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:19.270129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 466/913] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:19.290629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a607ec0-0233-4dab-bf43-c1b736c4790b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:19.332392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81c05f-7cb0-478e-ad76-23d3c930c3d2 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:19.374152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77a985-4a47-42eb-89f4-cbb1338ea2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:19.374821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77a985-4a47-42eb-89f4-cbb1338ea2b9 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:19.375106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77a985-4a47-42eb-89f4-cbb1338ea2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:19.375379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77a985-4a47-42eb-89f4-cbb1338ea2b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:19.376204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77a985-4a47-42eb-89f4-cbb1338ea2b9 None admin] RBAC: Adding query filter params (role.id=34c5fd7c7f2f45e7811bfab9ccd5f806, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=e4f27325efd04f74b572def6a7060d9d) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:19.376517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77a985-4a47-42eb-89f4-cbb1338ea2b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:19.377950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77a985-4a47-42eb-89f4-cbb1338ea2b9 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:19.385057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 448/914] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:19 2022] GET /identity/v3/role_assignments?user.id=e4f27325efd04f74b572def6a7060d9d&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=34c5fd7c7f2f45e7811bfab9ccd5f806 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:19.415711 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a607ec0-0233-4dab-bf43-c1b736c4790b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:19.453254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0dddb-7d33-4871-978c-24795e74d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:19.454079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0dddb-7d33-4871-978c-24795e74d31d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:19.454396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0dddb-7d33-4871-978c-24795e74d31d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:19.454666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0dddb-7d33-4871-978c-24795e74d31d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:19.455331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0dddb-7d33-4871-978c-24795e74d31d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:19.456740 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0dddb-7d33-4871-978c-24795e74d31d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:19.469408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-d7f0dddb-7d33-4871-978c-24795e74d31d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 10 17:12:19.471014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 467/915] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:12:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:19.476917 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77a985-4a47-42eb-89f4-cbb1338ea2b9 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:19.584566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77a985-4a47-42eb-89f4-cbb1338ea2b9 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:19.620258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5cff1-7f1f-42a5-8087-6821794e3183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:19.620921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5cff1-7f1f-42a5-8087-6821794e3183 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:19.621251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5cff1-7f1f-42a5-8087-6821794e3183 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:19.621531 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5cff1-7f1f-42a5-8087-6821794e3183 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:19.622254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5cff1-7f1f-42a5-8087-6821794e3183 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:19.622636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5cff1-7f1f-42a5-8087-6821794e3183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:19.623989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5cff1-7f1f-42a5-8087-6821794e3183 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:19.628833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 449/916] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:12:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:19.635324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0dddb-7d33-4871-978c-24795e74d31d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:19.736723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0dddb-7d33-4871-978c-24795e74d31d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:19.769497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39dafc-0515-47e5-a970-d48d184545b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:19.771103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39dafc-0515-47e5-a970-d48d184545b8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:19.771593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39dafc-0515-47e5-a970-d48d184545b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:19.772088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39dafc-0515-47e5-a970-d48d184545b8 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:19.772997 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39dafc-0515-47e5-a970-d48d184545b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:19.773527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39dafc-0515-47e5-a970-d48d184545b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:19.775130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39dafc-0515-47e5-a970-d48d184545b8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:19.780745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 468/917] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Mar 10 17:12:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:19.787293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5cff1-7f1f-42a5-8087-6821794e3183 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:19.890201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5cff1-7f1f-42a5-8087-6821794e3183 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:19.925294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c9ccc-589e-4250-bf6c-7460edf87a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:19.926299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c9ccc-589e-4250-bf6c-7460edf87a73 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:19.926819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c9ccc-589e-4250-bf6c-7460edf87a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:19.927298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c9ccc-589e-4250-bf6c-7460edf87a73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:19.928234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c9ccc-589e-4250-bf6c-7460edf87a73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:19.929810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c9ccc-589e-4250-bf6c-7460edf87a73 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:19.951772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 450/918] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Mar 10 17:12:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:12:20.520691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d0d7-3d3e-4734-816b-63f0fdeaa24d None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:20.521257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d0d7-3d3e-4734-816b-63f0fdeaa24d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:20.521257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d0d7-3d3e-4734-816b-63f0fdeaa24d None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:20.523398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 469/919] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:20.529344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfb205-b4b3-475f-a06c-e0e9b3104966 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:20.529669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfb205-b4b3-475f-a06c-e0e9b3104966 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:20.529898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfb205-b4b3-475f-a06c-e0e9b3104966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:20.547081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-90cfb205-b4b3-475f-a06c-e0e9b3104966 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:20.548260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-90cfb205-b4b3-475f-a06c-e0e9b3104966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:20.627429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 451/920] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:20.650151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d0d7-3d3e-4734-816b-63f0fdeaa24d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:20.752367 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d0d7-3d3e-4734-816b-63f0fdeaa24d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:20.785055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ecd6e-10ee-4ad7-9c1b-d4a6933cc47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:20.786434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecd6e-10ee-4ad7-9c1b-d4a6933cc47d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:20.786720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecd6e-10ee-4ad7-9c1b-d4a6933cc47d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:20.786992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecd6e-10ee-4ad7-9c1b-d4a6933cc47d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:20.787631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ecd6e-10ee-4ad7-9c1b-d4a6933cc47d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:20.788976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ecd6e-10ee-4ad7-9c1b-d4a6933cc47d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:20.800567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-079ecd6e-10ee-4ad7-9c1b-d4a6933cc47d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 10 17:12:20.802702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 470/921] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Mar 10 17:12:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:20.808971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfb205-b4b3-475f-a06c-e0e9b3104966 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:20.882491 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec3a53-7cae-46e5-b638-78e5a9072a9c None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:20.882683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec3a53-7cae-46e5-b638-78e5a9072a9c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:20.882992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec3a53-7cae-46e5-b638-78e5a9072a9c None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:20.885963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 471/922] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:20.889912 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd5dae-1121-4899-ba8c-1dff39cb3a3b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:20.890243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd5dae-1121-4899-ba8c-1dff39cb3a3b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:20.890526 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd5dae-1121-4899-ba8c-1dff39cb3a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:20.907154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-30cd5dae-1121-4899-ba8c-1dff39cb3a3b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:20.908519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-30cd5dae-1121-4899-ba8c-1dff39cb3a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:20.915144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfb205-b4b3-475f-a06c-e0e9b3104966 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:20.956695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa35a-0025-4dfc-b8ed-d4b3f2b93094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:20.957365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa35a-0025-4dfc-b8ed-d4b3f2b93094 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:20.957649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa35a-0025-4dfc-b8ed-d4b3f2b93094 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:20.958121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa35a-0025-4dfc-b8ed-d4b3f2b93094 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:20.959116 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa35a-0025-4dfc-b8ed-d4b3f2b93094 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:20.959422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa35a-0025-4dfc-b8ed-d4b3f2b93094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:20.960792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa35a-0025-4dfc-b8ed-d4b3f2b93094 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:20.967142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 452/923] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:20.972350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa35a-0025-4dfc-b8ed-d4b3f2b93094 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:20.986224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 472/924] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:21.000667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd5dae-1121-4899-ba8c-1dff39cb3a3b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:21.080977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa35a-0025-4dfc-b8ed-d4b3f2b93094 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:21.114896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed18ec-a68e-4a00-ac61-cfaf6d371b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:21.115554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed18ec-a68e-4a00-ac61-cfaf6d371b45 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:21.115832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed18ec-a68e-4a00-ac61-cfaf6d371b45 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:21.116103 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed18ec-a68e-4a00-ac61-cfaf6d371b45 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:21.116850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed18ec-a68e-4a00-ac61-cfaf6d371b45 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:21.117149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed18ec-a68e-4a00-ac61-cfaf6d371b45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:21.118602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed18ec-a68e-4a00-ac61-cfaf6d371b45 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:21.121474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd5dae-1121-4899-ba8c-1dff39cb3a3b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:21.128258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 453/925] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:21.129262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed18ec-a68e-4a00-ac61-cfaf6d371b45 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:21.170556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f220d8-6e87-4ee4-afbc-4cd02bebbd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:21.172676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f220d8-6e87-4ee4-afbc-4cd02bebbd61 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:21.173167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f220d8-6e87-4ee4-afbc-4cd02bebbd61 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:21.174008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f220d8-6e87-4ee4-afbc-4cd02bebbd61 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:21.174904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f220d8-6e87-4ee4-afbc-4cd02bebbd61 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:21.177051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f220d8-6e87-4ee4-afbc-4cd02bebbd61 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:21.192394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-09f220d8-6e87-4ee4-afbc-4cd02bebbd61 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 17:12:21.194770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 473/926] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:21.207268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f220d8-6e87-4ee4-afbc-4cd02bebbd61 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:21.234507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed18ec-a68e-4a00-ac61-cfaf6d371b45 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:21.268630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e0fb-feec-48c3-a345-d86290ad7f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:21.269570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e0fb-feec-48c3-a345-d86290ad7f60 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:21.269851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e0fb-feec-48c3-a345-d86290ad7f60 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:21.270151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e0fb-feec-48c3-a345-d86290ad7f60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:21.271416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e0fb-feec-48c3-a345-d86290ad7f60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:21.273205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e0fb-feec-48c3-a345-d86290ad7f60 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:21.300269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 454/927] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Mar 10 17:12:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:12:21.328401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f220d8-6e87-4ee4-afbc-4cd02bebbd61 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:21.372697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb048ea0-b196-46e5-b8e0-6a5bb2a18c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:21.373379 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb048ea0-b196-46e5-b8e0-6a5bb2a18c32 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:21.373664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb048ea0-b196-46e5-b8e0-6a5bb2a18c32 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:21.373999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb048ea0-b196-46e5-b8e0-6a5bb2a18c32 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:21.374745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb048ea0-b196-46e5-b8e0-6a5bb2a18c32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:21.375056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb048ea0-b196-46e5-b8e0-6a5bb2a18c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:21.376489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb048ea0-b196-46e5-b8e0-6a5bb2a18c32 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:21.386247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 474/928] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:21.388468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e0fb-feec-48c3-a345-d86290ad7f60 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:21.499093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e0fb-feec-48c3-a345-d86290ad7f60 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:21.534135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69141fb-acf5-4568-87b2-cbe063e61d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:21.534818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69141fb-acf5-4568-87b2-cbe063e61d2b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:21.535101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69141fb-acf5-4568-87b2-cbe063e61d2b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:21.535375 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69141fb-acf5-4568-87b2-cbe063e61d2b None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:21.536120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69141fb-acf5-4568-87b2-cbe063e61d2b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:21.536424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69141fb-acf5-4568-87b2-cbe063e61d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:21.537894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69141fb-acf5-4568-87b2-cbe063e61d2b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:21.543346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 455/929] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:21.552511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb048ea0-b196-46e5-b8e0-6a5bb2a18c32 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:21.654368 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb048ea0-b196-46e5-b8e0-6a5bb2a18c32 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:21.688098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f013fc-eeab-40de-83e0-337ed9fc9d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:21.688849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f013fc-eeab-40de-83e0-337ed9fc9d36 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:21.689177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f013fc-eeab-40de-83e0-337ed9fc9d36 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:21.689454 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f013fc-eeab-40de-83e0-337ed9fc9d36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:21.690334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f013fc-eeab-40de-83e0-337ed9fc9d36 None admin] RBAC: Adding query filter params (interface=public, service_id=2cc8e320dbfd4f4ab5f4eae6c0874066, region_id=RegionOne) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:21.690652 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f013fc-eeab-40de-83e0-337ed9fc9d36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:21.692017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f013fc-eeab-40de-83e0-337ed9fc9d36 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:21.698139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 475/930] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Mar 10 17:12:21 2022] GET /identity/v3/endpoints?service_id=2cc8e320dbfd4f4ab5f4eae6c0874066&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:21.703460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69141fb-acf5-4568-87b2-cbe063e61d2b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:21.803122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69141fb-acf5-4568-87b2-cbe063e61d2b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:21.838542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d24ec-33f5-474d-8e89-323bc163f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:21.839569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d24ec-33f5-474d-8e89-323bc163f987 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:21.840053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d24ec-33f5-474d-8e89-323bc163f987 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:21.840544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d24ec-33f5-474d-8e89-323bc163f987 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:21.841423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d24ec-33f5-474d-8e89-323bc163f987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:21.843025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d24ec-33f5-474d-8e89-323bc163f987 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:21.845339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b14057-f8de-446c-a42c-0f2f4ccfd143 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:21.845628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b14057-f8de-446c-a42c-0f2f4ccfd143 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:21.845905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b14057-f8de-446c-a42c-0f2f4ccfd143 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:21.847929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 476/931] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:21.850504 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 456/932] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Mar 10 17:12:21 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:12:21.852918 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ec539-765b-4f04-92a8-cfd3523b528d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:21.853273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ec539-765b-4f04-92a8-cfd3523b528d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:21.853566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ec539-765b-4f04-92a8-cfd3523b528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:21.872459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8d0ec539-765b-4f04-92a8-cfd3523b528d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:21.873676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8d0ec539-765b-4f04-92a8-cfd3523b528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:21.946261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 477/933] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:21.969452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d24ec-33f5-474d-8e89-323bc163f987 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:22.085208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d24ec-33f5-474d-8e89-323bc163f987 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:22.118567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74334b83-69f5-4aee-8762-9bbace4f6ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:22.119379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74334b83-69f5-4aee-8762-9bbace4f6ec8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.119663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74334b83-69f5-4aee-8762-9bbace4f6ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.119939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74334b83-69f5-4aee-8762-9bbace4f6ec8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.130649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74334b83-69f5-4aee-8762-9bbace4f6ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:22.138391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-74334b83-69f5-4aee-8762-9bbace4f6ec8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 17:12:22.140690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 457/934] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Mar 10 17:12:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:22.146366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ec539-765b-4f04-92a8-cfd3523b528d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:22.248104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ec539-765b-4f04-92a8-cfd3523b528d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:22.280516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe55e7-7374-42c9-a76c-e17095bd8a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:22.281184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe55e7-7374-42c9-a76c-e17095bd8a4a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.281550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe55e7-7374-42c9-a76c-e17095bd8a4a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.281827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe55e7-7374-42c9-a76c-e17095bd8a4a None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.282591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe55e7-7374-42c9-a76c-e17095bd8a4a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:22.282893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe55e7-7374-42c9-a76c-e17095bd8a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:22.284235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe55e7-7374-42c9-a76c-e17095bd8a4a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:22.299101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 478/935] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Mar 10 17:12:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:22.310359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74334b83-69f5-4aee-8762-9bbace4f6ec8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:22.391166 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfa5ef-3dfd-4c06-b37a-df6f971b207e None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.391373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfa5ef-3dfd-4c06-b37a-df6f971b207e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.391899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfa5ef-3dfd-4c06-b37a-df6f971b207e None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.394086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 479/936] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:22.400779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f80140-06a3-47ba-9c2d-11f577dcf8fe None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.401340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f80140-06a3-47ba-9c2d-11f577dcf8fe None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.401853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f80140-06a3-47ba-9c2d-11f577dcf8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.414383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74334b83-69f5-4aee-8762-9bbace4f6ec8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:22.421702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e3f80140-06a3-47ba-9c2d-11f577dcf8fe None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:22.423160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e3f80140-06a3-47ba-9c2d-11f577dcf8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:22.447962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdbf57-eb70-4973-926d-843a178879ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:22.448975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdbf57-eb70-4973-926d-843a178879ca None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.449421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdbf57-eb70-4973-926d-843a178879ca None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.449828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdbf57-eb70-4973-926d-843a178879ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.460690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdbf57-eb70-4973-926d-843a178879ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:22.462435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdbf57-eb70-4973-926d-843a178879ca None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:22.479515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-a3cdbf57-eb70-4973-926d-843a178879ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:22.481497 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 458/937] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:22.487404 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdbf57-eb70-4973-926d-843a178879ca None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:22.502201 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 480/938] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:22.516398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f80140-06a3-47ba-9c2d-11f577dcf8fe None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:22.590960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdbf57-eb70-4973-926d-843a178879ca None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:22.617643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f80140-06a3-47ba-9c2d-11f577dcf8fe None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:22.625090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39b96a-36b0-4d8d-aa4f-fbfdf44b42d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:22.625746 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39b96a-36b0-4d8d-aa4f-fbfdf44b42d8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.626030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39b96a-36b0-4d8d-aa4f-fbfdf44b42d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.626336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39b96a-36b0-4d8d-aa4f-fbfdf44b42d8 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.627048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39b96a-36b0-4d8d-aa4f-fbfdf44b42d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:22.627351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39b96a-36b0-4d8d-aa4f-fbfdf44b42d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:22.628712 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39b96a-36b0-4d8d-aa4f-fbfdf44b42d8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:22.640759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 459/939] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:22.646726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39b96a-36b0-4d8d-aa4f-fbfdf44b42d8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:22.655252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:22.656241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.656723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.657196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.658096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:22.659761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:22.661881 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.common [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 10 17:12:22.679736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.sql.core [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 10 17:12:22.679736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 10 17:12:22.679736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [parameters: {'id': 'c3854ce22df74a63b63d11895c23a81b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 10 17:12:22.679736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79406) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 10 17:12:22.686073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c3854ce22df74a63b63d11895c23a81b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c3854ce22df74a63b63d11895c23a81b. Mar 10 17:12:22.692362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 481/940] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Mar 10 17:12:22 2022] POST /identity/v3/projects => generated 262 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:22.695051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:22.766771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39b96a-36b0-4d8d-aa4f-fbfdf44b42d8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:22.801228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135beb9-635e-4e44-8bbf-f0db7836549d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:22.802056 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff813b-101f-42f4-93c4-44d14110a8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:22.803008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff813b-101f-42f4-93c4-44d14110a8f8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.803365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff813b-101f-42f4-93c4-44d14110a8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.803799 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff813b-101f-42f4-93c4-44d14110a8f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.812865 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff813b-101f-42f4-93c4-44d14110a8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:22.814465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff813b-101f-42f4-93c4-44d14110a8f8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:22.829101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-37ff813b-101f-42f4-93c4-44d14110a8f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 17:12:22.835138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 460/941] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:12:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:22.836629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff813b-101f-42f4-93c4-44d14110a8f8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:22.838784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14411-5fbd-43a9-8138-651a415d2dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:22.839700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14411-5fbd-43a9-8138-651a415d2dcc None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.839890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14411-5fbd-43a9-8138-651a415d2dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.840130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14411-5fbd-43a9-8138-651a415d2dcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.846862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14411-5fbd-43a9-8138-651a415d2dcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:22.849055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14411-5fbd-43a9-8138-651a415d2dcc None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:22.862646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-6fe14411-5fbd-43a9-8138-651a415d2dcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:22.868744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 482/942] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:22.869628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14411-5fbd-43a9-8138-651a415d2dcc None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:22.938165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff813b-101f-42f4-93c4-44d14110a8f8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:22.967909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14411-5fbd-43a9-8138-651a415d2dcc None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:22.972727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d257840-411a-4c5b-9345-6bbb3f36ed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:22.974315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d257840-411a-4c5b-9345-6bbb3f36ed26 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:22.974801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d257840-411a-4c5b-9345-6bbb3f36ed26 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:22.975264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d257840-411a-4c5b-9345-6bbb3f36ed26 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:22.976300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d257840-411a-4c5b-9345-6bbb3f36ed26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:22.976812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d257840-411a-4c5b-9345-6bbb3f36ed26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:22.978456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d257840-411a-4c5b-9345-6bbb3f36ed26 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:23.000844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 461/943] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Mar 10 17:12:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:23.002282 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d257840-411a-4c5b-9345-6bbb3f36ed26 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:23.004308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112ed3-8e8a-40c4-80a7-33d14609e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:23.005554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112ed3-8e8a-40c4-80a7-33d14609e4aa None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:23.005847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112ed3-8e8a-40c4-80a7-33d14609e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:23.006146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112ed3-8e8a-40c4-80a7-33d14609e4aa None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:23.006966 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91112ed3-8e8a-40c4-80a7-33d14609e4aa None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:23.007273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91112ed3-8e8a-40c4-80a7-33d14609e4aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:23.008759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91112ed3-8e8a-40c4-80a7-33d14609e4aa None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:23.038470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 483/944] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:23.112170 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d257840-411a-4c5b-9345-6bbb3f36ed26 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:23.149856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a353a-245c-4c4d-b524-fc69a589efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:23.151076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a353a-245c-4c4d-b524-fc69a589efed None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:23.151585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a353a-245c-4c4d-b524-fc69a589efed None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:23.152054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a353a-245c-4c4d-b524-fc69a589efed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:23.163415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a353a-245c-4c4d-b524-fc69a589efed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:23.165243 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a353a-245c-4c4d-b524-fc69a589efed None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:23.184020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-0d3a353a-245c-4c4d-b524-fc69a589efed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:23.186036 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 462/945] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:23.192584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112ed3-8e8a-40c4-80a7-33d14609e4aa None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:23.297441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112ed3-8e8a-40c4-80a7-33d14609e4aa None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:23.335523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15a71c-6940-4825-94c2-af5e64fe4124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:23.336240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15a71c-6940-4825-94c2-af5e64fe4124 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:23.336528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15a71c-6940-4825-94c2-af5e64fe4124 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:23.336805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15a71c-6940-4825-94c2-af5e64fe4124 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:23.337524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15a71c-6940-4825-94c2-af5e64fe4124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:23.337827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15a71c-6940-4825-94c2-af5e64fe4124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:23.339200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15a71c-6940-4825-94c2-af5e64fe4124 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:23.350885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 484/946] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:23.356441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a353a-245c-4c4d-b524-fc69a589efed None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:23.463322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a353a-245c-4c4d-b524-fc69a589efed None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:23.496967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1903fed-6ed3-4024-8b73-3a40a7176563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:23.497763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1903fed-6ed3-4024-8b73-3a40a7176563 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:23.498044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1903fed-6ed3-4024-8b73-3a40a7176563 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:23.498339 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1903fed-6ed3-4024-8b73-3a40a7176563 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:23.505335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1903fed-6ed3-4024-8b73-3a40a7176563 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:23.507048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1903fed-6ed3-4024-8b73-3a40a7176563 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:23.522862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-b1903fed-6ed3-4024-8b73-3a40a7176563 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:23.524334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 463/947] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:23.529928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15a71c-6940-4825-94c2-af5e64fe4124 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:23.627510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15a71c-6940-4825-94c2-af5e64fe4124 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:23.662471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48d9a3-58d6-44fe-8b0c-4f34d9292165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:23.663501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48d9a3-58d6-44fe-8b0c-4f34d9292165 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:23.664000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48d9a3-58d6-44fe-8b0c-4f34d9292165 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:23.664474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48d9a3-58d6-44fe-8b0c-4f34d9292165 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:23.665444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48d9a3-58d6-44fe-8b0c-4f34d9292165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:23.665967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48d9a3-58d6-44fe-8b0c-4f34d9292165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:23.667607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48d9a3-58d6-44fe-8b0c-4f34d9292165 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:23.680587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 485/948] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:23.686131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1903fed-6ed3-4024-8b73-3a40a7176563 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:23.784580 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1903fed-6ed3-4024-8b73-3a40a7176563 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:23.789898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f82380-12c1-447c-87ce-8a9db4fbaf82 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:23.790287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f82380-12c1-447c-87ce-8a9db4fbaf82 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:23.790641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f82380-12c1-447c-87ce-8a9db4fbaf82 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:23.792739 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 486/949] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:23.797989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96dc4e-16bf-4b71-829e-246a02ddd78e None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:23.798546 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96dc4e-16bf-4b71-829e-246a02ddd78e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:23.799045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96dc4e-16bf-4b71-829e-246a02ddd78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:23.816769 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fb96dc4e-16bf-4b71-829e-246a02ddd78e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:23.819400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fb96dc4e-16bf-4b71-829e-246a02ddd78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:23.819819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff014002-7e5c-4d50-8bcc-5a43d689d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:23.820714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014002-7e5c-4d50-8bcc-5a43d689d202 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:23.820994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014002-7e5c-4d50-8bcc-5a43d689d202 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:23.821267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014002-7e5c-4d50-8bcc-5a43d689d202 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/e4f27325efd04f74b572def6a7060d9d/roles/34c5fd7c7f2f45e7811bfab9ccd5f806` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:23.823576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff014002-7e5c-4d50-8bcc-5a43d689d202 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=e4f27325efd04f74b572def6a7060d9d, role_id=34c5fd7c7f2f45e7811bfab9ccd5f806)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:23.825002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff014002-7e5c-4d50-8bcc-5a43d689d202 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:23.842227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 464/950] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:12:23 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/e4f27325efd04f74b572def6a7060d9d/roles/34c5fd7c7f2f45e7811bfab9ccd5f806 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:12:23.907455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 487/951] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:23.932205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff014002-7e5c-4d50-8bcc-5a43d689d202 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:24.043204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff014002-7e5c-4d50-8bcc-5a43d689d202 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:24.080828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbf1e8-7c1d-4fad-b466-b57daa515ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:24.081626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf1e8-7c1d-4fad-b466-b57daa515ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:24.081905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf1e8-7c1d-4fad-b466-b57daa515ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:24.082204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf1e8-7c1d-4fad-b466-b57daa515ac1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:24.082961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbf1e8-7c1d-4fad-b466-b57daa515ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:24.084323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbf1e8-7c1d-4fad-b466-b57daa515ac1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:24.095565 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-98cbf1e8-7c1d-4fad-b466-b57daa515ac1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 10 17:12:24.097156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 465/952] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:24.105167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96dc4e-16bf-4b71-829e-246a02ddd78e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:24.209997 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96dc4e-16bf-4b71-829e-246a02ddd78e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:24.244831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4011c-706e-402c-ae36-16f36724624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:24.245781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4011c-706e-402c-ae36-16f36724624a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:24.246255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4011c-706e-402c-ae36-16f36724624a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:24.246677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4011c-706e-402c-ae36-16f36724624a None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:24.247544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4011c-706e-402c-ae36-16f36724624a None admin] RBAC: Adding query filter params (name=compute) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:24.247998 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4011c-706e-402c-ae36-16f36724624a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:24.249492 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4011c-706e-402c-ae36-16f36724624a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:24.253563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88e0e-8749-4539-b821-dc9103bda76a None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:24.253966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88e0e-8749-4539-b821-dc9103bda76a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:24.254371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88e0e-8749-4539-b821-dc9103bda76a None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:24.255556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 488/953] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:24.258189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 466/954] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:24.261229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4011c-706e-402c-ae36-16f36724624a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:24.261675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c7df7-f14c-4455-8374-220798003fe8 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:24.262083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c7df7-f14c-4455-8374-220798003fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:24.262389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c7df7-f14c-4455-8374-220798003fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:24.279197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d95c7df7-f14c-4455-8374-220798003fe8 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:24.280384 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d95c7df7-f14c-4455-8374-220798003fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:24.359128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 467/955] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:24.382792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c7df7-f14c-4455-8374-220798003fe8 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:24.383702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4011c-706e-402c-ae36-16f36724624a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:24.421839 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66ab51-fc8f-462e-a42b-1a9111e67cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:24.422882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66ab51-fc8f-462e-a42b-1a9111e67cc6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:24.423360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66ab51-fc8f-462e-a42b-1a9111e67cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:24.423846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66ab51-fc8f-462e-a42b-1a9111e67cc6 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:24.424734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66ab51-fc8f-462e-a42b-1a9111e67cc6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:24.425243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66ab51-fc8f-462e-a42b-1a9111e67cc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:24.428087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66ab51-fc8f-462e-a42b-1a9111e67cc6 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:24.434556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 489/956] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:24.493203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c7df7-f14c-4455-8374-220798003fe8 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:24.529467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a74c-4e0a-4533-8467-99f316c3f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:24.530784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a74c-4e0a-4533-8467-99f316c3f956 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:24.531276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a74c-4e0a-4533-8467-99f316c3f956 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:24.531750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a74c-4e0a-4533-8467-99f316c3f956 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:24.532611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6a74c-4e0a-4533-8467-99f316c3f956 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:24.534235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6a74c-4e0a-4533-8467-99f316c3f956 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:24.547566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-c0d6a74c-4e0a-4533-8467-99f316c3f956 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 17:12:24.549496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 468/957] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:24.556109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66ab51-fc8f-462e-a42b-1a9111e67cc6 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:24.659395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66ab51-fc8f-462e-a42b-1a9111e67cc6 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:24.694637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a4ecd-65b5-4baa-bc3d-945a26cd03bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:24.695699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a4ecd-65b5-4baa-bc3d-945a26cd03bf None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:24.696231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a4ecd-65b5-4baa-bc3d-945a26cd03bf None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:24.696702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a4ecd-65b5-4baa-bc3d-945a26cd03bf None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:24.697597 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a4ecd-65b5-4baa-bc3d-945a26cd03bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:24.698124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a4ecd-65b5-4baa-bc3d-945a26cd03bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:24.699741 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a4ecd-65b5-4baa-bc3d-945a26cd03bf None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:24.709470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 490/958] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:24.711107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a74c-4e0a-4533-8467-99f316c3f956 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:24.810651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a74c-4e0a-4533-8467-99f316c3f956 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:24.844621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86af2f1-e195-4207-bc3f-10f89c5f408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:24.845282 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86af2f1-e195-4207-bc3f-10f89c5f408a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:24.845563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86af2f1-e195-4207-bc3f-10f89c5f408a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:24.845839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86af2f1-e195-4207-bc3f-10f89c5f408a None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:24.846572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86af2f1-e195-4207-bc3f-10f89c5f408a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:24.846875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86af2f1-e195-4207-bc3f-10f89c5f408a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:24.848793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86af2f1-e195-4207-bc3f-10f89c5f408a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:24.853977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 469/959] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:24.859808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a4ecd-65b5-4baa-bc3d-945a26cd03bf None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:24.961844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a4ecd-65b5-4baa-bc3d-945a26cd03bf None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:24.999596 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c605cb3-0297-4e36-b5c5-37e9cb393d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:25.000262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605cb3-0297-4e36-b5c5-37e9cb393d45 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:25.000543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605cb3-0297-4e36-b5c5-37e9cb393d45 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:25.000816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605cb3-0297-4e36-b5c5-37e9cb393d45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:25.001555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605cb3-0297-4e36-b5c5-37e9cb393d45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:25.002940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605cb3-0297-4e36-b5c5-37e9cb393d45 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:25.023472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 491/960] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Mar 10 17:12:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:12:25.511890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c042f9-8bcd-4e79-aabb-df391ca10fd9 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:25.512267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c042f9-8bcd-4e79-aabb-df391ca10fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:25.512445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c042f9-8bcd-4e79-aabb-df391ca10fd9 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:25.514500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 470/961] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:25.520747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c206-2115-462c-9ff6-078284c88a22 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:25.521043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c206-2115-462c-9ff6-078284c88a22 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:25.521325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c206-2115-462c-9ff6-078284c88a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:25.538009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-29b5c206-2115-462c-9ff6-078284c88a22 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:25.539235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-29b5c206-2115-462c-9ff6-078284c88a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:25.613514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 492/962] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:25.638789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c042f9-8bcd-4e79-aabb-df391ca10fd9 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:25.745595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c042f9-8bcd-4e79-aabb-df391ca10fd9 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:25.779501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:25.780169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:25.780448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:25.780721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:25.781409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:25.782850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:25.784143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.common [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 10 17:12:25.797231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.sql.core [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 10 17:12:25.797231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 10 17:12:25.797231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [parameters: {'user_id': '8ca5820923fe416fa50bd2fbb96166f9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 10 17:12:25.797231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79405) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 10 17:12:25.813129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 10 17:12:25.814946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 471/963] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Mar 10 17:12:25 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:25.823239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5c206-2115-462c-9ff6-078284c88a22 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:25.923738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5c206-2115-462c-9ff6-078284c88a22 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:25.962817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce7a5f-88b3-4bfb-80bc-6f37dc2aa677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:25.963613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce7a5f-88b3-4bfb-80bc-6f37dc2aa677 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:25.963877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce7a5f-88b3-4bfb-80bc-6f37dc2aa677 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:25.964146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce7a5f-88b3-4bfb-80bc-6f37dc2aa677 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:25.971166 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce7a5f-88b3-4bfb-80bc-6f37dc2aa677 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:25.972592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce7a5f-88b3-4bfb-80bc-6f37dc2aa677 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:25.986525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-21ce7a5f-88b3-4bfb-80bc-6f37dc2aa677 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 10 17:12:25.987962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 493/964] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:12:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:25.994126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:26.096524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f010a8d-acf7-4730-b1db-f841d450147e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:26.134132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b564b9-2ea9-4b05-8c0f-d8628b61c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:26.134132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b564b9-2ea9-4b05-8c0f-d8628b61c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:26.134132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b564b9-2ea9-4b05-8c0f-d8628b61c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:26.134132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b564b9-2ea9-4b05-8c0f-d8628b61c7b8 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:26.134896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b564b9-2ea9-4b05-8c0f-d8628b61c7b8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:26.134896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b564b9-2ea9-4b05-8c0f-d8628b61c7b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:26.134896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b564b9-2ea9-4b05-8c0f-d8628b61c7b8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:26.173983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 472/965] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Mar 10 17:12:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:26.264825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78270743-f2ce-427b-b1b2-e5da70ad67dd None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:26.265472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78270743-f2ce-427b-b1b2-e5da70ad67dd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:26.265975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78270743-f2ce-427b-b1b2-e5da70ad67dd None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:26.268358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 494/966] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:26.274479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f7ba-996a-4937-b2c4-be0b53625944 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:26.275075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f7ba-996a-4937-b2c4-be0b53625944 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:26.275556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f7ba-996a-4937-b2c4-be0b53625944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:26.298595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b4d2f7ba-996a-4937-b2c4-be0b53625944 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:26.300135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b4d2f7ba-996a-4937-b2c4-be0b53625944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:26.376627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 473/967] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:26.401958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78270743-f2ce-427b-b1b2-e5da70ad67dd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:26.507564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78270743-f2ce-427b-b1b2-e5da70ad67dd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:26.539886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1a50a-2f58-495e-b43a-18005d696ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:26.540703 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1a50a-2f58-495e-b43a-18005d696ee1 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:26.540983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1a50a-2f58-495e-b43a-18005d696ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:26.541254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1a50a-2f58-495e-b43a-18005d696ee1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:26.552747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1a50a-2f58-495e-b43a-18005d696ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:26.560486 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-bed1a50a-2f58-495e-b43a-18005d696ee1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 17:12:26.561762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 495/968] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Mar 10 17:12:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:26.567879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f7ba-996a-4937-b2c4-be0b53625944 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:26.664070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f7ba-996a-4937-b2c4-be0b53625944 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:26.695948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf196d95-7201-4106-a4c9-85fbdf662a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:26.696608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf196d95-7201-4106-a4c9-85fbdf662a23 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:26.696893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf196d95-7201-4106-a4c9-85fbdf662a23 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:26.697165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf196d95-7201-4106-a4c9-85fbdf662a23 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:26.697904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf196d95-7201-4106-a4c9-85fbdf662a23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:26.698231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf196d95-7201-4106-a4c9-85fbdf662a23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:26.699590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf196d95-7201-4106-a4c9-85fbdf662a23 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:26.708240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 474/969] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Mar 10 17:12:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:26.714042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1a50a-2f58-495e-b43a-18005d696ee1 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:26.809215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1a50a-2f58-495e-b43a-18005d696ee1 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:26.841403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56722e-a40d-464c-9177-d14711c9e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:26.842228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56722e-a40d-464c-9177-d14711c9e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:26.842515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56722e-a40d-464c-9177-d14711c9e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:26.842794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56722e-a40d-464c-9177-d14711c9e7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:26.852893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56722e-a40d-464c-9177-d14711c9e7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:26.854350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56722e-a40d-464c-9177-d14711c9e7b6 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:26.870572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-cc56722e-a40d-464c-9177-d14711c9e7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:26.871957 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 496/970] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:26.877370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf196d95-7201-4106-a4c9-85fbdf662a23 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:26.923884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e2012-3643-40dc-bb29-d96b5d2f79c1 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:26.924198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e2012-3643-40dc-bb29-d96b5d2f79c1 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:26.924458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e2012-3643-40dc-bb29-d96b5d2f79c1 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:26.926286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 497/971] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:26.931103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bd6a8-426e-412f-9503-79bdfff069c0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:26.931396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bd6a8-426e-412f-9503-79bdfff069c0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:26.931673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bd6a8-426e-412f-9503-79bdfff069c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:26.948530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-797bd6a8-426e-412f-9503-79bdfff069c0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:26.949719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-797bd6a8-426e-412f-9503-79bdfff069c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:26.995453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf196d95-7201-4106-a4c9-85fbdf662a23 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:27.015250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 498/972] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:27.032394 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53aa2b-75a4-4f51-878a-9a32e44ea1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:27.033327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53aa2b-75a4-4f51-878a-9a32e44ea1c8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.033847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53aa2b-75a4-4f51-878a-9a32e44ea1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.034344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53aa2b-75a4-4f51-878a-9a32e44ea1c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.035253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53aa2b-75a4-4f51-878a-9a32e44ea1c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:27.035788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53aa2b-75a4-4f51-878a-9a32e44ea1c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:27.037463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53aa2b-75a4-4f51-878a-9a32e44ea1c8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:27.038383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bd6a8-426e-412f-9503-79bdfff069c0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:27.053205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 475/973] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:27.057683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53aa2b-75a4-4f51-878a-9a32e44ea1c8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:27.142899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bd6a8-426e-412f-9503-79bdfff069c0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:27.155094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53aa2b-75a4-4f51-878a-9a32e44ea1c8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:27.176842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df65f0-5239-4b61-979e-350ad48d0d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:27.177515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df65f0-5239-4b61-979e-350ad48d0d1e None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.177799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df65f0-5239-4b61-979e-350ad48d0d1e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.178088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df65f0-5239-4b61-979e-350ad48d0d1e None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.178823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df65f0-5239-4b61-979e-350ad48d0d1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:27.180167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df65f0-5239-4b61-979e-350ad48d0d1e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:27.189944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fce57-a7f6-467a-b56a-ad2c1ab1aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:27.190884 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fce57-a7f6-467a-b56a-ad2c1ab1aed3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.191167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fce57-a7f6-467a-b56a-ad2c1ab1aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.191443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fce57-a7f6-467a-b56a-ad2c1ab1aed3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.194482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 499/974] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:12:27 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:12:27.211748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fce57-a7f6-467a-b56a-ad2c1ab1aed3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:27.213251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fce57-a7f6-467a-b56a-ad2c1ab1aed3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:27.229484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-758fce57-a7f6-467a-b56a-ad2c1ab1aed3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 17:12:27.230998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 476/975] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:12:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:27.236575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df65f0-5239-4b61-979e-350ad48d0d1e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:27.364268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df65f0-5239-4b61-979e-350ad48d0d1e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:27.399251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8691-0256-4d82-a9b5-f66028bf78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:27.399861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8691-0256-4d82-a9b5-f66028bf78d9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.400148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8691-0256-4d82-a9b5-f66028bf78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.400434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8691-0256-4d82-a9b5-f66028bf78d9 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.401248 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8691-0256-4d82-a9b5-f66028bf78d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:27.401557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8691-0256-4d82-a9b5-f66028bf78d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:27.403003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8691-0256-4d82-a9b5-f66028bf78d9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:27.421078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 500/976] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Mar 10 17:12:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:27.426873 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fce57-a7f6-467a-b56a-ad2c1ab1aed3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:27.430605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9ab33-b974-4831-a923-6ca74968247a None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.430896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9ab33-b974-4831-a923-6ca74968247a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.431177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9ab33-b974-4831-a923-6ca74968247a None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.432962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 501/977] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:27.438377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7592913-2f2d-4eca-a415-d9fb9bdb01ad None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.438669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7592913-2f2d-4eca-a415-d9fb9bdb01ad None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.438943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7592913-2f2d-4eca-a415-d9fb9bdb01ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.455797 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e7592913-2f2d-4eca-a415-d9fb9bdb01ad None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:27.456979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e7592913-2f2d-4eca-a415-d9fb9bdb01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:27.526623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fce57-a7f6-467a-b56a-ad2c1ab1aed3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:27.528126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 502/978] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:27.544562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7592913-2f2d-4eca-a415-d9fb9bdb01ad None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:27.559076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6189d-1ae6-486d-991c-7b526b6d71cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:27.559730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6189d-1ae6-486d-991c-7b526b6d71cd None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.560010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6189d-1ae6-486d-991c-7b526b6d71cd None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.560280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6189d-1ae6-486d-991c-7b526b6d71cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.639251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6189d-1ae6-486d-991c-7b526b6d71cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:27.641041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6189d-1ae6-486d-991c-7b526b6d71cd None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:27.646422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7592913-2f2d-4eca-a415-d9fb9bdb01ad None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:27.682031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623ce00-9c36-4b29-9dbd-15de4a2b40c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:27.683151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623ce00-9c36-4b29-9dbd-15de4a2b40c4 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.683430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623ce00-9c36-4b29-9dbd-15de4a2b40c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.683704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623ce00-9c36-4b29-9dbd-15de4a2b40c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.684346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623ce00-9c36-4b29-9dbd-15de4a2b40c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:27.685691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623ce00-9c36-4b29-9dbd-15de4a2b40c4 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:27.697197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-1623ce00-9c36-4b29-9dbd-15de4a2b40c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 17:12:27.698555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 503/979] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:27.704170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623ce00-9c36-4b29-9dbd-15de4a2b40c4 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:27.745113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 477/980] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:27 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:12:27.750524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6189d-1ae6-486d-991c-7b526b6d71cd None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:27.801383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623ce00-9c36-4b29-9dbd-15de4a2b40c4 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:27.833515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d81d1-8ea2-417c-a83b-28afa51f9005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:27.834198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d81d1-8ea2-417c-a83b-28afa51f9005 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.834486 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d81d1-8ea2-417c-a83b-28afa51f9005 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.834764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d81d1-8ea2-417c-a83b-28afa51f9005 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.835461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d81d1-8ea2-417c-a83b-28afa51f9005 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:27.835770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d81d1-8ea2-417c-a83b-28afa51f9005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:27.837115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d81d1-8ea2-417c-a83b-28afa51f9005 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:27.841633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 504/981] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:27.847030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6189d-1ae6-486d-991c-7b526b6d71cd None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:27.847235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d81d1-8ea2-417c-a83b-28afa51f9005 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:27.880241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712469e0-9edb-4186-9719-a154b53e377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:27.881036 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712469e0-9edb-4186-9719-a154b53e377b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.881319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712469e0-9edb-4186-9719-a154b53e377b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.881595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712469e0-9edb-4186-9719-a154b53e377b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.891387 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712469e0-9edb-4186-9719-a154b53e377b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:27.892844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712469e0-9edb-4186-9719-a154b53e377b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:27.910390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-712469e0-9edb-4186-9719-a154b53e377b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:27.916321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 478/982] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:27.917151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712469e0-9edb-4186-9719-a154b53e377b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:27.951286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d81d1-8ea2-417c-a83b-28afa51f9005 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:27.985684 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bacfb3-c524-4a9c-977c-576d5b8f9704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:27.986540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bacfb3-c524-4a9c-977c-576d5b8f9704 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:27.986818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bacfb3-c524-4a9c-977c-576d5b8f9704 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:27.987090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bacfb3-c524-4a9c-977c-576d5b8f9704 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:27.987786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bacfb3-c524-4a9c-977c-576d5b8f9704 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:27.988088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bacfb3-c524-4a9c-977c-576d5b8f9704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:27.989987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bacfb3-c524-4a9c-977c-576d5b8f9704 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:27.999626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 505/983] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:28.000625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bacfb3-c524-4a9c-977c-576d5b8f9704 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:28.022512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712469e0-9edb-4186-9719-a154b53e377b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:28.056371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b812ec9-4f1e-43d7-a19b-51923c521554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:28.057030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b812ec9-4f1e-43d7-a19b-51923c521554 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:28.057322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b812ec9-4f1e-43d7-a19b-51923c521554 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:28.057596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b812ec9-4f1e-43d7-a19b-51923c521554 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:28.058338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b812ec9-4f1e-43d7-a19b-51923c521554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:28.058642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b812ec9-4f1e-43d7-a19b-51923c521554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:28.059992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b812ec9-4f1e-43d7-a19b-51923c521554 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:28.075882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 479/984] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:28.076959 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b812ec9-4f1e-43d7-a19b-51923c521554 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:28.098179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bacfb3-c524-4a9c-977c-576d5b8f9704 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:28.132146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4c4a4-ec3c-4087-8b30-b7ca00bdf752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:28.132789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4c4a4-ec3c-4087-8b30-b7ca00bdf752 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:28.133072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4c4a4-ec3c-4087-8b30-b7ca00bdf752 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:28.133343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4c4a4-ec3c-4087-8b30-b7ca00bdf752 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:28.134157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4c4a4-ec3c-4087-8b30-b7ca00bdf752 None admin] RBAC: Adding query filter params (interface=admin, service_id=2cc8e320dbfd4f4ab5f4eae6c0874066, region_id=RegionOne) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:28.134458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4c4a4-ec3c-4087-8b30-b7ca00bdf752 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:28.135815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4c4a4-ec3c-4087-8b30-b7ca00bdf752 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:28.145252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 506/985] 10.222.0.16 () {56 vars in 1249 bytes} [Thu Mar 10 17:12:27 2022] GET /identity/v3/endpoints?service_id=2cc8e320dbfd4f4ab5f4eae6c0874066&interface=admin®ion_id=RegionOne => generated 193 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:28.146234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4c4a4-ec3c-4087-8b30-b7ca00bdf752 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:28.178458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b812ec9-4f1e-43d7-a19b-51923c521554 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:28.211423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b4bc9-a2b5-4af4-ba63-2f3384c22f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:28.212135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b4bc9-a2b5-4af4-ba63-2f3384c22f4b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:28.212423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b4bc9-a2b5-4af4-ba63-2f3384c22f4b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:28.212701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b4bc9-a2b5-4af4-ba63-2f3384c22f4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:28.219454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b4bc9-a2b5-4af4-ba63-2f3384c22f4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:28.220905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b4bc9-a2b5-4af4-ba63-2f3384c22f4b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:28.234778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-be5b4bc9-a2b5-4af4-ba63-2f3384c22f4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:28.236111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 480/986] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:28.242007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4c4a4-ec3c-4087-8b30-b7ca00bdf752 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:28.242235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b4bc9-a2b5-4af4-ba63-2f3384c22f4b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:28.275090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dcdff-7ecc-4a5d-a266-ef15134a1823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:28.275766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dcdff-7ecc-4a5d-a266-ef15134a1823 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:28.276051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dcdff-7ecc-4a5d-a266-ef15134a1823 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:28.276328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dcdff-7ecc-4a5d-a266-ef15134a1823 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:28.277006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dcdff-7ecc-4a5d-a266-ef15134a1823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:28.278390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dcdff-7ecc-4a5d-a266-ef15134a1823 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:28.284488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 507/987] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Mar 10 17:12:28 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:12:28.344272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b4bc9-a2b5-4af4-ba63-2f3384c22f4b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:28.382568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52405c5-3af2-4af1-8b1d-be8858675633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:28.383256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52405c5-3af2-4af1-8b1d-be8858675633 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:28.383541 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52405c5-3af2-4af1-8b1d-be8858675633 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:28.383823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52405c5-3af2-4af1-8b1d-be8858675633 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:28.384627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52405c5-3af2-4af1-8b1d-be8858675633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:28.384938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52405c5-3af2-4af1-8b1d-be8858675633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:28.386428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52405c5-3af2-4af1-8b1d-be8858675633 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:28.403702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 481/988] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:28.405044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dcdff-7ecc-4a5d-a266-ef15134a1823 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:28.505695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dcdff-7ecc-4a5d-a266-ef15134a1823 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:28.538437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0d4ad-3c5b-455e-9421-c490a62ffab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:28.539092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0d4ad-3c5b-455e-9421-c490a62ffab9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:28.539371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0d4ad-3c5b-455e-9421-c490a62ffab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:28.539643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0d4ad-3c5b-455e-9421-c490a62ffab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:28.540460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0d4ad-3c5b-455e-9421-c490a62ffab9 None admin] RBAC: Adding query filter params (role.id=34c5fd7c7f2f45e7811bfab9ccd5f806, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=e4f27325efd04f74b572def6a7060d9d) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:28.540770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0d4ad-3c5b-455e-9421-c490a62ffab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:28.542199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0d4ad-3c5b-455e-9421-c490a62ffab9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:28.549520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 508/989] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:28 2022] GET /identity/v3/role_assignments?user.id=e4f27325efd04f74b572def6a7060d9d&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=34c5fd7c7f2f45e7811bfab9ccd5f806 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:29.543557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa371c-c874-4985-b157-9a93c27ad4ee None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:29.544066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa371c-c874-4985-b157-9a93c27ad4ee None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:29.544141 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa371c-c874-4985-b157-9a93c27ad4ee None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:29.546307 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 482/990] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:29.551303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd936-67b3-4446-b760-be12ddaf0270 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:29.551687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd936-67b3-4446-b760-be12ddaf0270 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:29.551860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd936-67b3-4446-b760-be12ddaf0270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:29.568263 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-082cd936-67b3-4446-b760-be12ddaf0270 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:29.569374 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-082cd936-67b3-4446-b760-be12ddaf0270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:29.636709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 509/991] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:29.659650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa371c-c874-4985-b157-9a93c27ad4ee None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:29.758971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa371c-c874-4985-b157-9a93c27ad4ee None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:29.791410 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd041-d510-42a5-8178-d583fd73bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:29.792197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd041-d510-42a5-8178-d583fd73bc41 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:29.792479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd041-d510-42a5-8178-d583fd73bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:29.792755 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd041-d510-42a5-8178-d583fd73bc41 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:29.793400 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd041-d510-42a5-8178-d583fd73bc41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:29.794793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd041-d510-42a5-8178-d583fd73bc41 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:29.805907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-df1dd041-d510-42a5-8178-d583fd73bc41 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 10 17:12:29.807149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 483/992] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:29.812969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd936-67b3-4446-b760-be12ddaf0270 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:29.908470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd936-67b3-4446-b760-be12ddaf0270 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:29.940904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3d949-7105-469d-83ad-81d59ec9676e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:29.941577 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3d949-7105-469d-83ad-81d59ec9676e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:29.942437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3d949-7105-469d-83ad-81d59ec9676e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:29.942720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3d949-7105-469d-83ad-81d59ec9676e None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:29.943416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3d949-7105-469d-83ad-81d59ec9676e None admin] RBAC: Adding query filter params (name=compute) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:29.943720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3d949-7105-469d-83ad-81d59ec9676e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:29.945056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3d949-7105-469d-83ad-81d59ec9676e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:29.954418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 510/993] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:29.955628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd041-d510-42a5-8178-d583fd73bc41 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:30.055419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd041-d510-42a5-8178-d583fd73bc41 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:30.087512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e1917-e16f-4980-9eac-93362db56692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:30.088166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e1917-e16f-4980-9eac-93362db56692 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:30.088445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e1917-e16f-4980-9eac-93362db56692 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:30.088716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e1917-e16f-4980-9eac-93362db56692 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:30.089415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e1917-e16f-4980-9eac-93362db56692 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:30.089736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e1917-e16f-4980-9eac-93362db56692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:30.091132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e1917-e16f-4980-9eac-93362db56692 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:30.095977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 484/994] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:30.101554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3d949-7105-469d-83ad-81d59ec9676e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:30.196343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3d949-7105-469d-83ad-81d59ec9676e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:30.227743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf131da5-ffdd-414f-bfac-bed34e8a0ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:30.228407 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf131da5-ffdd-414f-bfac-bed34e8a0ab8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:30.228690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf131da5-ffdd-414f-bfac-bed34e8a0ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:30.228964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf131da5-ffdd-414f-bfac-bed34e8a0ab8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:30.229748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf131da5-ffdd-414f-bfac-bed34e8a0ab8 None admin] RBAC: Adding query filter params (interface=public, service_id=9ce26367362c4233b8aadd9219903054, region_id=RegionOne) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:30.230058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf131da5-ffdd-414f-bfac-bed34e8a0ab8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:30.231459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf131da5-ffdd-414f-bfac-bed34e8a0ab8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:30.236928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 511/995] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Mar 10 17:12:30 2022] GET /identity/v3/endpoints?service_id=9ce26367362c4233b8aadd9219903054&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:30.243402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e1917-e16f-4980-9eac-93362db56692 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:30.349546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e1917-e16f-4980-9eac-93362db56692 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:30.381942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d2bb-a1d7-496e-bc92-9be58d6a5892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:30.382637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d2bb-a1d7-496e-bc92-9be58d6a5892 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:30.382924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d2bb-a1d7-496e-bc92-9be58d6a5892 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:30.383200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d2bb-a1d7-496e-bc92-9be58d6a5892 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:30.383875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d2bb-a1d7-496e-bc92-9be58d6a5892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:30.385228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d2bb-a1d7-496e-bc92-9be58d6a5892 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:30.398150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 485/996] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Mar 10 17:12:30 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:12:30.616642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100298f-d89b-4e9d-b0c9-a82743f79ddf None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:30.617140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100298f-d89b-4e9d-b0c9-a82743f79ddf None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:30.617216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100298f-d89b-4e9d-b0c9-a82743f79ddf None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:30.619134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 512/997] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:30.624204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451df48-d2cd-467b-924d-68c7b9ed109a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:30.624580 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451df48-d2cd-467b-924d-68c7b9ed109a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:30.624760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451df48-d2cd-467b-924d-68c7b9ed109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:30.641422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-0451df48-d2cd-467b-924d-68c7b9ed109a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:30.642653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0451df48-d2cd-467b-924d-68c7b9ed109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:30.707970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 486/998] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:30.731348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100298f-d89b-4e9d-b0c9-a82743f79ddf None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:30.831376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100298f-d89b-4e9d-b0c9-a82743f79ddf None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:30.864527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe662-0453-4368-bf3b-796b4fde35fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:30.865337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe662-0453-4368-bf3b-796b4fde35fe None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:30.865623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe662-0453-4368-bf3b-796b4fde35fe None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:30.865901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe662-0453-4368-bf3b-796b4fde35fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:30.866579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfe662-0453-4368-bf3b-796b4fde35fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:30.868014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfe662-0453-4368-bf3b-796b4fde35fe None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:30.878827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-60cfe662-0453-4368-bf3b-796b4fde35fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 17:12:30.880311 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 513/999] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Mar 10 17:12:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:30.886003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451df48-d2cd-467b-924d-68c7b9ed109a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:30.890812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb832a-a7fd-4d74-b9e0-cccdd8d5e399 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:30.891101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb832a-a7fd-4d74-b9e0-cccdd8d5e399 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:30.891374 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb832a-a7fd-4d74-b9e0-cccdd8d5e399 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:30.893223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 514/1000] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:30.898457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62eac5-93ca-4c52-86a2-eb085d503b82 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:30.898749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62eac5-93ca-4c52-86a2-eb085d503b82 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:30.899027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62eac5-93ca-4c52-86a2-eb085d503b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:30.918566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4a62eac5-93ca-4c52-86a2-eb085d503b82 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:30.919744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4a62eac5-93ca-4c52-86a2-eb085d503b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:30.981139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451df48-d2cd-467b-924d-68c7b9ed109a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:30.982708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 515/1001] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:31.004382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62eac5-93ca-4c52-86a2-eb085d503b82 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:31.017259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6724692-e89c-43d8-b3ae-bf0f47ad6ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:31.017928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6724692-e89c-43d8-b3ae-bf0f47ad6ed5 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:31.018247 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6724692-e89c-43d8-b3ae-bf0f47ad6ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:31.018534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6724692-e89c-43d8-b3ae-bf0f47ad6ed5 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:31.019231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6724692-e89c-43d8-b3ae-bf0f47ad6ed5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:31.019539 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6724692-e89c-43d8-b3ae-bf0f47ad6ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:31.021428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6724692-e89c-43d8-b3ae-bf0f47ad6ed5 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:31.025972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 487/1002] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:31.031485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6724692-e89c-43d8-b3ae-bf0f47ad6ed5 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:31.101087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62eac5-93ca-4c52-86a2-eb085d503b82 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:31.128827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6724692-e89c-43d8-b3ae-bf0f47ad6ed5 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:31.133133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d246de0-43ee-456c-8da9-4b71bbe9b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:31.133939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d246de0-43ee-456c-8da9-4b71bbe9b84e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:31.134262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d246de0-43ee-456c-8da9-4b71bbe9b84e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:31.134541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d246de0-43ee-456c-8da9-4b71bbe9b84e None admin] PATH_INFO: `/v3/services/image` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:31.135185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d246de0-43ee-456c-8da9-4b71bbe9b84e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:31.136544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d246de0-43ee-456c-8da9-4b71bbe9b84e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:31.147640 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-6d246de0-43ee-456c-8da9-4b71bbe9b84e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 10 17:12:31.153609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 516/1003] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Mar 10 17:12:31 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:31.155073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d246de0-43ee-456c-8da9-4b71bbe9b84e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:31.162769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088124-4508-4ec4-a163-eb509b313009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:31.163476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088124-4508-4ec4-a163-eb509b313009 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:31.163755 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088124-4508-4ec4-a163-eb509b313009 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:31.164026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088124-4508-4ec4-a163-eb509b313009 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:31.164717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64088124-4508-4ec4-a163-eb509b313009 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:31.165019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64088124-4508-4ec4-a163-eb509b313009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:31.166396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64088124-4508-4ec4-a163-eb509b313009 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:31.171383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 488/1004] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Mar 10 17:12:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:31.176965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088124-4508-4ec4-a163-eb509b313009 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:31.259440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d246de0-43ee-456c-8da9-4b71bbe9b84e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:31.271525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088124-4508-4ec4-a163-eb509b313009 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:31.297960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48787e-f009-4f99-a962-c2b4f20a9cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:31.298671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48787e-f009-4f99-a962-c2b4f20a9cf5 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:31.298959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48787e-f009-4f99-a962-c2b4f20a9cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:31.299238 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48787e-f009-4f99-a962-c2b4f20a9cf5 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:31.299941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48787e-f009-4f99-a962-c2b4f20a9cf5 None admin] RBAC: Adding query filter params (name=image) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:31.300473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48787e-f009-4f99-a962-c2b4f20a9cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:31.301669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48787e-f009-4f99-a962-c2b4f20a9cf5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:31.309927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 517/1005] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:31.314331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec1f1f-20cc-42f4-bfcb-a9f5d633faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:31.315002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec1f1f-20cc-42f4-bfcb-a9f5d633faf6 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:31.315285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec1f1f-20cc-42f4-bfcb-a9f5d633faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:31.315784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec1f1f-20cc-42f4-bfcb-a9f5d633faf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:31.316586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec1f1f-20cc-42f4-bfcb-a9f5d633faf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:31.317650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48787e-f009-4f99-a962-c2b4f20a9cf5 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:31.318529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec1f1f-20cc-42f4-bfcb-a9f5d633faf6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:31.336736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 489/1006] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Mar 10 17:12:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:12:31.425850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48787e-f009-4f99-a962-c2b4f20a9cf5 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:31.466865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1ad2-7c40-4726-aaa6-66b1c3082211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:31.467551 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1ad2-7c40-4726-aaa6-66b1c3082211 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:31.467837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1ad2-7c40-4726-aaa6-66b1c3082211 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:31.468115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1ad2-7c40-4726-aaa6-66b1c3082211 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:31.468826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a1ad2-7c40-4726-aaa6-66b1c3082211 None admin] RBAC: Adding query filter params (type=image) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:31.469132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a1ad2-7c40-4726-aaa6-66b1c3082211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:31.470578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a1ad2-7c40-4726-aaa6-66b1c3082211 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:31.482466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 518/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:32.763351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2720-e4cf-47d9-8506-2364244a5a03 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:32.763906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2720-e4cf-47d9-8506-2364244a5a03 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:32.764127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2720-e4cf-47d9-8506-2364244a5a03 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:32.765996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 490/1008] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:32.771082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ea75f-d7c0-4acb-a779-040826e1084c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:32.771457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ea75f-d7c0-4acb-a779-040826e1084c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:32.771644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ea75f-d7c0-4acb-a779-040826e1084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:32.788355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-5f7ea75f-d7c0-4acb-a779-040826e1084c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:32.789520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-5f7ea75f-d7c0-4acb-a779-040826e1084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:32.852638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 519/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:32.876022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2720-e4cf-47d9-8506-2364244a5a03 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:32.983303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2720-e4cf-47d9-8506-2364244a5a03 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:33.015536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72c6e3-d71d-4f13-90ba-c1244ce3ca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:33.016258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72c6e3-d71d-4f13-90ba-c1244ce3ca5c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:33.016569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72c6e3-d71d-4f13-90ba-c1244ce3ca5c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:33.016845 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72c6e3-d71d-4f13-90ba-c1244ce3ca5c None admin] PATH_INFO: `/v3/services/compute` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:33.017501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72c6e3-d71d-4f13-90ba-c1244ce3ca5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:33.018908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72c6e3-d71d-4f13-90ba-c1244ce3ca5c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:33.029687 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-dd72c6e3-d71d-4f13-90ba-c1244ce3ca5c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 10 17:12:33.030890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 491/1010] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:33.037487 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ea75f-d7c0-4acb-a779-040826e1084c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:33.131782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ea75f-d7c0-4acb-a779-040826e1084c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:33.164438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bf416-aa17-45fd-8bf3-a94b9502f67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:33.165107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bf416-aa17-45fd-8bf3-a94b9502f67a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:33.165389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bf416-aa17-45fd-8bf3-a94b9502f67a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:33.165665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bf416-aa17-45fd-8bf3-a94b9502f67a None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:33.166391 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bf416-aa17-45fd-8bf3-a94b9502f67a None admin] RBAC: Adding query filter params (name=compute) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:33.166700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bf416-aa17-45fd-8bf3-a94b9502f67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:33.168050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bf416-aa17-45fd-8bf3-a94b9502f67a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:33.177637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 520/1011] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:33.178915 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72c6e3-d71d-4f13-90ba-c1244ce3ca5c None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:33.274346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72c6e3-d71d-4f13-90ba-c1244ce3ca5c None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:33.310591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc28bc-0fcb-4853-b07c-f17cfa06a000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:33.311276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc28bc-0fcb-4853-b07c-f17cfa06a000 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:33.311565 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc28bc-0fcb-4853-b07c-f17cfa06a000 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:33.311843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc28bc-0fcb-4853-b07c-f17cfa06a000 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:33.312592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc28bc-0fcb-4853-b07c-f17cfa06a000 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:33.312900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc28bc-0fcb-4853-b07c-f17cfa06a000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:33.316068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc28bc-0fcb-4853-b07c-f17cfa06a000 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:33.322181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 492/1012] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Mar 10 17:12:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:33.328015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bf416-aa17-45fd-8bf3-a94b9502f67a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:33.428996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bf416-aa17-45fd-8bf3-a94b9502f67a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:33.461442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f9ab2-d9ea-477a-a5eb-969f8285c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:33.462120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f9ab2-d9ea-477a-a5eb-969f8285c4e2 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:33.462415 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f9ab2-d9ea-477a-a5eb-969f8285c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:33.462692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f9ab2-d9ea-477a-a5eb-969f8285c4e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:33.463422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f9ab2-d9ea-477a-a5eb-969f8285c4e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:33.464783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f9ab2-d9ea-477a-a5eb-969f8285c4e2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:33.483321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 521/1013] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Mar 10 17:12:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:12:33.694509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53065ac3-dee0-45a3-a85e-cf243d16e296 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:33.694735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53065ac3-dee0-45a3-a85e-cf243d16e296 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:33.695002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53065ac3-dee0-45a3-a85e-cf243d16e296 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:33.697103 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 493/1014] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:33.702527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293497d-ce29-45d7-b86a-b17eee65e3f2 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:33.702822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293497d-ce29-45d7-b86a-b17eee65e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:33.703102 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293497d-ce29-45d7-b86a-b17eee65e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:33.721091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0293497d-ce29-45d7-b86a-b17eee65e3f2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:33.722313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0293497d-ce29-45d7-b86a-b17eee65e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:33.768386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98da907-4a8c-42d2-bd40-099fca6e81f5 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:33.768896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98da907-4a8c-42d2-bd40-099fca6e81f5 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:33.768975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98da907-4a8c-42d2-bd40-099fca6e81f5 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:33.771286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 494/1015] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:33.776323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863fb48-8e40-41f9-8422-59c2c1944c5a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:33.776614 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863fb48-8e40-41f9-8422-59c2c1944c5a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:33.776894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863fb48-8e40-41f9-8422-59c2c1944c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:33.793247 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-7863fb48-8e40-41f9-8422-59c2c1944c5a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:33.794552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7863fb48-8e40-41f9-8422-59c2c1944c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:33.798824 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 522/1016] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:33 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:33.822513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293497d-ce29-45d7-b86a-b17eee65e3f2 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:33.860367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 495/1017] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:33 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:33.883826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863fb48-8e40-41f9-8422-59c2c1944c5a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:33.919597 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293497d-ce29-45d7-b86a-b17eee65e3f2 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:33.953186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21bdc8-5b17-44e0-94a9-c697525e89f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:33.953902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bdc8-5b17-44e0-94a9-c697525e89f3 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:33.954207 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bdc8-5b17-44e0-94a9-c697525e89f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:33.954480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bdc8-5b17-44e0-94a9-c697525e89f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:33.955643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21bdc8-5b17-44e0-94a9-c697525e89f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:33.957058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21bdc8-5b17-44e0-94a9-c697525e89f3 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:33.958893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 523/1018] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:33.964232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21bdc8-5b17-44e0-94a9-c697525e89f3 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:33.988147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863fb48-8e40-41f9-8422-59c2c1944c5a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:34.023395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232817a8-d364-4309-af20-3643e8d771e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:34.024051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232817a8-d364-4309-af20-3643e8d771e0 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:34.024334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232817a8-d364-4309-af20-3643e8d771e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:34.024606 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232817a8-d364-4309-af20-3643e8d771e0 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:34.025306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232817a8-d364-4309-af20-3643e8d771e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:34.026709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232817a8-d364-4309-af20-3643e8d771e0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:34.048941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 496/1019] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:12:33 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:12:34.062528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21bdc8-5b17-44e0-94a9-c697525e89f3 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:34.104332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd7604-7c7d-42e7-81b2-34bd1580605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:34.105016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd7604-7c7d-42e7-81b2-34bd1580605c None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:34.105296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd7604-7c7d-42e7-81b2-34bd1580605c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:34.105568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd7604-7c7d-42e7-81b2-34bd1580605c None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:34.106325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd7604-7c7d-42e7-81b2-34bd1580605c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:34.107865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd7604-7c7d-42e7-81b2-34bd1580605c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:34.137029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 524/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:12:33 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:12:35.929708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58fe5b-07ed-4fc2-b39a-c4ac2ac41b2d None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:35.930257 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58fe5b-07ed-4fc2-b39a-c4ac2ac41b2d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:35.930335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58fe5b-07ed-4fc2-b39a-c4ac2ac41b2d None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:35.932113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 497/1021] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:35.937376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9c883-5faf-48ba-9bd2-2af1aa2a35dc None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:35.937767 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9c883-5faf-48ba-9bd2-2af1aa2a35dc None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:35.937954 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9c883-5faf-48ba-9bd2-2af1aa2a35dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:35.955200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-6ba9c883-5faf-48ba-9bd2-2af1aa2a35dc None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:35.956375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6ba9c883-5faf-48ba-9bd2-2af1aa2a35dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:36.026157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 525/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:36.060648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58fe5b-07ed-4fc2-b39a-c4ac2ac41b2d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.162803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58fe5b-07ed-4fc2-b39a-c4ac2ac41b2d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:36.195389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e23e71-7e8a-4d6c-853a-2646ad133160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:36.196139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e23e71-7e8a-4d6c-853a-2646ad133160 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.196423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e23e71-7e8a-4d6c-853a-2646ad133160 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.196700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e23e71-7e8a-4d6c-853a-2646ad133160 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.206323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e23e71-7e8a-4d6c-853a-2646ad133160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:36.213758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-a1e23e71-7e8a-4d6c-853a-2646ad133160 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 17:12:36.215126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 498/1023] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Mar 10 17:12:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:36.220921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9c883-5faf-48ba-9bd2-2af1aa2a35dc None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.320376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9c883-5faf-48ba-9bd2-2af1aa2a35dc None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:36.352310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b79ded-f35e-4309-9bcd-cb6d1b97fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:36.352983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b79ded-f35e-4309-9bcd-cb6d1b97fd6c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.353267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b79ded-f35e-4309-9bcd-cb6d1b97fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.353546 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b79ded-f35e-4309-9bcd-cb6d1b97fd6c None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.354316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b79ded-f35e-4309-9bcd-cb6d1b97fd6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:36.354626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b79ded-f35e-4309-9bcd-cb6d1b97fd6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:36.355981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b79ded-f35e-4309-9bcd-cb6d1b97fd6c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:36.369288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 526/1024] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Mar 10 17:12:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:36.370596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e23e71-7e8a-4d6c-853a-2646ad133160 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.396079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e3b0-20d8-4f66-86af-e3038868b038 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.396371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e3b0-20d8-4f66-86af-e3038868b038 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.396656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e3b0-20d8-4f66-86af-e3038868b038 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.398606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 527/1025] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:36.403377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb9547-00a0-409b-bec9-f7dec7894082 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.403671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb9547-00a0-409b-bec9-f7dec7894082 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.404194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb9547-00a0-409b-bec9-f7dec7894082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.421825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-10cb9547-00a0-409b-bec9-f7dec7894082 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:36.423050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-10cb9547-00a0-409b-bec9-f7dec7894082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:36.473262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e23e71-7e8a-4d6c-853a-2646ad133160 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:36.487459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 528/1026] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:36.488809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f76ac-998c-45d6-a1a3-1e6f8b6c5208 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.489097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f76ac-998c-45d6-a1a3-1e6f8b6c5208 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.489378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f76ac-998c-45d6-a1a3-1e6f8b6c5208 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.492523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 529/1027] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:36.497118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c329eb-ce49-4e48-b45a-2bd970097cb3 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.497414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c329eb-ce49-4e48-b45a-2bd970097cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.497692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c329eb-ce49-4e48-b45a-2bd970097cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.506761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872a685-40a3-420f-995c-faf59bb9f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:36.507554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872a685-40a3-420f-995c-faf59bb9f556 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.507836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872a685-40a3-420f-995c-faf59bb9f556 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.508095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872a685-40a3-420f-995c-faf59bb9f556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.515107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f0c329eb-ce49-4e48-b45a-2bd970097cb3 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:36.516270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f0c329eb-ce49-4e48-b45a-2bd970097cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:36.519022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872a685-40a3-420f-995c-faf59bb9f556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:36.520501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872a685-40a3-420f-995c-faf59bb9f556 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:36.536544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-c872a685-40a3-420f-995c-faf59bb9f556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:36.537694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 499/1028] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:36.538467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872a685-40a3-420f-995c-faf59bb9f556 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.578782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 530/1029] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:36.579605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c329eb-ce49-4e48-b45a-2bd970097cb3 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.635873 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872a685-40a3-420f-995c-faf59bb9f556 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:36.667114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eef585-eeab-4a65-b47c-a0847fe49ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:36.667884 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eef585-eeab-4a65-b47c-a0847fe49ea0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.668163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eef585-eeab-4a65-b47c-a0847fe49ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.668434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eef585-eeab-4a65-b47c-a0847fe49ea0 None admin] PATH_INFO: `/v3/services/image` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.669071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eef585-eeab-4a65-b47c-a0847fe49ea0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:36.670470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eef585-eeab-4a65-b47c-a0847fe49ea0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:36.671860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c329eb-ce49-4e48-b45a-2bd970097cb3 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:36.681618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-16eef585-eeab-4a65-b47c-a0847fe49ea0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 10 17:12:36.682783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 500/1030] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Mar 10 17:12:36 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:36.683540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eef585-eeab-4a65-b47c-a0847fe49ea0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.703969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9bbb2-dd8c-4181-8c33-71250c4488ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:36.704629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9bbb2-dd8c-4181-8c33-71250c4488ae None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.704917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9bbb2-dd8c-4181-8c33-71250c4488ae None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.705200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9bbb2-dd8c-4181-8c33-71250c4488ae None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.705910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9bbb2-dd8c-4181-8c33-71250c4488ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:36.706253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9bbb2-dd8c-4181-8c33-71250c4488ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:36.707601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9bbb2-dd8c-4181-8c33-71250c4488ae None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:36.718327 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 531/1031] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:36.719032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9bbb2-dd8c-4181-8c33-71250c4488ae None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.778338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eef585-eeab-4a65-b47c-a0847fe49ea0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:36.811768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547aeb48-7c82-45ab-898b-e8fcff2ee3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:36.811974 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9bbb2-dd8c-4181-8c33-71250c4488ae None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:36.812769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aeb48-7c82-45ab-898b-e8fcff2ee3cf None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.813117 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aeb48-7c82-45ab-898b-e8fcff2ee3cf None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.813400 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aeb48-7c82-45ab-898b-e8fcff2ee3cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.814619 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aeb48-7c82-45ab-898b-e8fcff2ee3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:36.816054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aeb48-7c82-45ab-898b-e8fcff2ee3cf None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:36.817664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 501/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:36.818520 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547aeb48-7c82-45ab-898b-e8fcff2ee3cf None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.844040 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd81cbc-4492-4932-b1a1-a4592170addb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:36.844707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81cbc-4492-4932-b1a1-a4592170addb None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.844993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81cbc-4492-4932-b1a1-a4592170addb None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.845272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81cbc-4492-4932-b1a1-a4592170addb None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.845970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd81cbc-4492-4932-b1a1-a4592170addb None admin] RBAC: Adding query filter params (name=image) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:36.846316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd81cbc-4492-4932-b1a1-a4592170addb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:36.847660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd81cbc-4492-4932-b1a1-a4592170addb None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:36.852715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 532/1033] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:36.853459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd81cbc-4492-4932-b1a1-a4592170addb None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.912497 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547aeb48-7c82-45ab-898b-e8fcff2ee3cf None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:36.943765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc981fc1-e77a-4b28-99f4-5f4d6215263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:36.944545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc981fc1-e77a-4b28-99f4-5f4d6215263f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.944828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc981fc1-e77a-4b28-99f4-5f4d6215263f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.945037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd81cbc-4492-4932-b1a1-a4592170addb None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:36.945392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc981fc1-e77a-4b28-99f4-5f4d6215263f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.952319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc981fc1-e77a-4b28-99f4-5f4d6215263f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:36.953751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc981fc1-e77a-4b28-99f4-5f4d6215263f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:36.967032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-fc981fc1-e77a-4b28-99f4-5f4d6215263f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 17:12:36.968187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 502/1034] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Mar 10 17:12:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:36.968934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc981fc1-e77a-4b28-99f4-5f4d6215263f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:36.977083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f10c-7a7b-45a0-b55e-df2cc7508ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:36.977749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f10c-7a7b-45a0-b55e-df2cc7508ec5 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:36.978036 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f10c-7a7b-45a0-b55e-df2cc7508ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:36.978353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f10c-7a7b-45a0-b55e-df2cc7508ec5 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:36.979054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67f10c-7a7b-45a0-b55e-df2cc7508ec5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:36.980458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67f10c-7a7b-45a0-b55e-df2cc7508ec5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:37.000476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 533/1035] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:12:36 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:12:37.001271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f10c-7a7b-45a0-b55e-df2cc7508ec5 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:37.075862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc981fc1-e77a-4b28-99f4-5f4d6215263f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:37.108510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f10c-7a7b-45a0-b55e-df2cc7508ec5 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:37.111930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0c4f3-4090-4e6b-b759-4238fc000ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:37.112613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0c4f3-4090-4e6b-b759-4238fc000ee7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:37.112904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0c4f3-4090-4e6b-b759-4238fc000ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:37.113186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0c4f3-4090-4e6b-b759-4238fc000ee7 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:37.114041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0c4f3-4090-4e6b-b759-4238fc000ee7 None admin] RBAC: Adding query filter params (type=image) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:37.114385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0c4f3-4090-4e6b-b759-4238fc000ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:37.115784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0c4f3-4090-4e6b-b759-4238fc000ee7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:37.125728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 503/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:37.126972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0c4f3-4090-4e6b-b759-4238fc000ee7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:37.143459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff6f17-8833-4f8c-8862-c1e7ae43d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:37.144157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6f17-8833-4f8c-8862-c1e7ae43d93e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:37.144456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6f17-8833-4f8c-8862-c1e7ae43d93e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:37.145282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6f17-8833-4f8c-8862-c1e7ae43d93e None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:37.146150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6f17-8833-4f8c-8862-c1e7ae43d93e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:37.146471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6f17-8833-4f8c-8862-c1e7ae43d93e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:37.147928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6f17-8833-4f8c-8862-c1e7ae43d93e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:37.167350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 534/1037] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Mar 10 17:12:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:37.173364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff6f17-8833-4f8c-8862-c1e7ae43d93e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:37.242283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0c4f3-4090-4e6b-b759-4238fc000ee7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:37.272916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff6f17-8833-4f8c-8862-c1e7ae43d93e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:37.278472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5d4db-7b7e-467c-b23a-f038207a53da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:37.279128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5d4db-7b7e-467c-b23a-f038207a53da None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:37.279411 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5d4db-7b7e-467c-b23a-f038207a53da None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:37.279692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5d4db-7b7e-467c-b23a-f038207a53da None admin] PATH_INFO: `/v3/endpoints` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:37.280479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5d4db-7b7e-467c-b23a-f038207a53da None admin] RBAC: Adding query filter params (interface=public, service_id=ba3e16065a6545329751f8ee967baf91, region_id=RegionOne) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:37.280788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5d4db-7b7e-467c-b23a-f038207a53da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:37.282178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5d4db-7b7e-467c-b23a-f038207a53da None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:37.287202 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 504/1038] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Mar 10 17:12:37 2022] GET /identity/v3/endpoints?service_id=ba3e16065a6545329751f8ee967baf91&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:37.292457 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5d4db-7b7e-467c-b23a-f038207a53da None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:37.311290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ab13a-18ae-4692-9fd6-eb6548ccf709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:37.312252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab13a-18ae-4692-9fd6-eb6548ccf709 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:37.312541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab13a-18ae-4692-9fd6-eb6548ccf709 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:37.312822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab13a-18ae-4692-9fd6-eb6548ccf709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:37.386272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ab13a-18ae-4692-9fd6-eb6548ccf709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:37.387630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ab13a-18ae-4692-9fd6-eb6548ccf709 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:37.392305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5d4db-7b7e-467c-b23a-f038207a53da None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:37.429715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc85811-bd15-4f38-a4c7-6886e62bbee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:37.430405 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc85811-bd15-4f38-a4c7-6886e62bbee3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:37.430696 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc85811-bd15-4f38-a4c7-6886e62bbee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:37.430972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc85811-bd15-4f38-a4c7-6886e62bbee3 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:37.431649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc85811-bd15-4f38-a4c7-6886e62bbee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:37.433034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc85811-bd15-4f38-a4c7-6886e62bbee3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:37.439532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 505/1039] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Mar 10 17:12:37 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:12:37.488649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 535/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 10 17:12:37.494374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc85811-bd15-4f38-a4c7-6886e62bbee3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:37.597397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc85811-bd15-4f38-a4c7-6886e62bbee3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:37.633393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d6d24-950c-4e88-9101-4ad7ff463ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:37.634211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6d24-950c-4e88-9101-4ad7ff463ca7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:37.634503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6d24-950c-4e88-9101-4ad7ff463ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:37.634772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6d24-950c-4e88-9101-4ad7ff463ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:37.645334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d6d24-950c-4e88-9101-4ad7ff463ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:37.646749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d6d24-950c-4e88-9101-4ad7ff463ca7 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:37.662487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-1b6d6d24-950c-4e88-9101-4ad7ff463ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:37.663818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 506/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:37.669210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ab13a-18ae-4692-9fd6-eb6548ccf709 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:37.787683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ab13a-18ae-4692-9fd6-eb6548ccf709 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:37.821438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7e85-b3c3-4167-bd36-49df09095df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:37.822115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7e85-b3c3-4167-bd36-49df09095df0 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:37.822407 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7e85-b3c3-4167-bd36-49df09095df0 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:37.822680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7e85-b3c3-4167-bd36-49df09095df0 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:37.823389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7e85-b3c3-4167-bd36-49df09095df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:37.823689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7e85-b3c3-4167-bd36-49df09095df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:37.825034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7e85-b3c3-4167-bd36-49df09095df0 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:37.840533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 536/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:37.842003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d6d24-950c-4e88-9101-4ad7ff463ca7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:37.937193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d6d24-950c-4e88-9101-4ad7ff463ca7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:37.968688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc88f1e-89ca-4189-bcf7-d66b88acce17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:37.969477 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc88f1e-89ca-4189-bcf7-d66b88acce17 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:37.969759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc88f1e-89ca-4189-bcf7-d66b88acce17 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:37.970034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc88f1e-89ca-4189-bcf7-d66b88acce17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:37.976987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc88f1e-89ca-4189-bcf7-d66b88acce17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:37.978446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc88f1e-89ca-4189-bcf7-d66b88acce17 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:37.992068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-8bc88f1e-89ca-4189-bcf7-d66b88acce17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:37.993362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 507/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:37.998958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7e85-b3c3-4167-bd36-49df09095df0 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:38.092984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7e85-b3c3-4167-bd36-49df09095df0 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:38.125738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872469b-f92f-44dd-8c7a-a7f679fa268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:38.126437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872469b-f92f-44dd-8c7a-a7f679fa268d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:38.126721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872469b-f92f-44dd-8c7a-a7f679fa268d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:38.126997 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872469b-f92f-44dd-8c7a-a7f679fa268d None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:38.127782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872469b-f92f-44dd-8c7a-a7f679fa268d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:38.128091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872469b-f92f-44dd-8c7a-a7f679fa268d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:38.129556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872469b-f92f-44dd-8c7a-a7f679fa268d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:38.141328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 537/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:38.147146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc88f1e-89ca-4189-bcf7-d66b88acce17 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:38.244353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc88f1e-89ca-4189-bcf7-d66b88acce17 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:38.276586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94e9c-9a15-465d-9c44-ca6882156914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:38.277241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94e9c-9a15-465d-9c44-ca6882156914 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:38.277526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94e9c-9a15-465d-9c44-ca6882156914 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:38.277803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94e9c-9a15-465d-9c44-ca6882156914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:38.278658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f94e9c-9a15-465d-9c44-ca6882156914 None admin] RBAC: Adding query filter params (role.id=34c5fd7c7f2f45e7811bfab9ccd5f806, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=89a64b4a57114f77a231a31e16b3923e) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:38.278975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f94e9c-9a15-465d-9c44-ca6882156914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:38.280390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f94e9c-9a15-465d-9c44-ca6882156914 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:38.286423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 508/1045] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:38 2022] GET /identity/v3/role_assignments?user.id=89a64b4a57114f77a231a31e16b3923e&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=34c5fd7c7f2f45e7811bfab9ccd5f806 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:39.388241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fbe12-ce0e-4478-8c25-d8d3bc5bc077 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:39.388787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fbe12-ce0e-4478-8c25-d8d3bc5bc077 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:39.388787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fbe12-ce0e-4478-8c25-d8d3bc5bc077 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:39.390764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 538/1046] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:39.397168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6027662-afd1-406a-90c6-fbdef8d15d17 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:39.397725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6027662-afd1-406a-90c6-fbdef8d15d17 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:39.397725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6027662-afd1-406a-90c6-fbdef8d15d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:39.415490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-c6027662-afd1-406a-90c6-fbdef8d15d17 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:39.416696 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c6027662-afd1-406a-90c6-fbdef8d15d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:39.483877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 509/1047] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:39.512632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fbe12-ce0e-4478-8c25-d8d3bc5bc077 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:39.608555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fbe12-ce0e-4478-8c25-d8d3bc5bc077 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:39.641649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4d62e-d1d0-42dc-8017-2d88df9d9983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:39.642468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4d62e-d1d0-42dc-8017-2d88df9d9983 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:39.642756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4d62e-d1d0-42dc-8017-2d88df9d9983 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:39.643035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4d62e-d1d0-42dc-8017-2d88df9d9983 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:39.652728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4d62e-d1d0-42dc-8017-2d88df9d9983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:39.659575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-76c4d62e-d1d0-42dc-8017-2d88df9d9983 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:12:39.661469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 539/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:39.667306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6027662-afd1-406a-90c6-fbdef8d15d17 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:39.762058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6027662-afd1-406a-90c6-fbdef8d15d17 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:39.762621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b2439-2594-4024-b001-4abedfd93c32 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:39.762906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b2439-2594-4024-b001-4abedfd93c32 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:39.763188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b2439-2594-4024-b001-4abedfd93c32 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:39.765075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 540/1049] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:39.770181 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b08a-447d-4e83-acbb-868b8fd66fcc None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:39.770592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b08a-447d-4e83-acbb-868b8fd66fcc None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:39.770880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b08a-447d-4e83-acbb-868b8fd66fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:39.789104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-b393b08a-447d-4e83-acbb-868b8fd66fcc None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:39.790356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b393b08a-447d-4e83-acbb-868b8fd66fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:39.862436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 541/1050] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:39.886056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b08a-447d-4e83-acbb-868b8fd66fcc None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:39.920927 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36382a10-d6a0-4eb2-b170-fb0e8fb3f062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:39.921597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36382a10-d6a0-4eb2-b170-fb0e8fb3f062 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:39.921879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36382a10-d6a0-4eb2-b170-fb0e8fb3f062 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:39.922175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36382a10-d6a0-4eb2-b170-fb0e8fb3f062 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:39.922918 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36382a10-d6a0-4eb2-b170-fb0e8fb3f062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:39.923223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36382a10-d6a0-4eb2-b170-fb0e8fb3f062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:39.924587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36382a10-d6a0-4eb2-b170-fb0e8fb3f062 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:39.932595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 510/1051] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:39.938194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36382a10-d6a0-4eb2-b170-fb0e8fb3f062 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:39.982409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b08a-447d-4e83-acbb-868b8fd66fcc None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.015612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a0b61-2bb8-4c2a-a473-9c6d75395f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.016470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a0b61-2bb8-4c2a-a473-9c6d75395f67 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.016761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a0b61-2bb8-4c2a-a473-9c6d75395f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.017042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a0b61-2bb8-4c2a-a473-9c6d75395f67 None admin] PATH_INFO: `/v3/services/image` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.017690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a0b61-2bb8-4c2a-a473-9c6d75395f67 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:40.019081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a0b61-2bb8-4c2a-a473-9c6d75395f67 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:40.030368 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-b22a0b61-2bb8-4c2a-a473-9c6d75395f67 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 10 17:12:40.031696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 542/1052] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Mar 10 17:12:39 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:40.032846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36382a10-d6a0-4eb2-b170-fb0e8fb3f062 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.037837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a0b61-2bb8-4c2a-a473-9c6d75395f67 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:40.066604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490797-6af4-4cb0-a1a1-899e5a8a8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.067472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490797-6af4-4cb0-a1a1-899e5a8a8957 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.067758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490797-6af4-4cb0-a1a1-899e5a8a8957 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.068035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490797-6af4-4cb0-a1a1-899e5a8a8957 None admin] PATH_INFO: `/v3/users/17d4d2594e69499f99582011674c955e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.080982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20490797-6af4-4cb0-a1a1-899e5a8a8957 None admin] RBAC: Authorizing `identity:get_user(user_id=17d4d2594e69499f99582011674c955e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:40.082992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20490797-6af4-4cb0-a1a1-899e5a8a8957 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:40.084645 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 511/1053] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:12:39 2022] GET /identity/v3/users/17d4d2594e69499f99582011674c955e => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:40.090276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490797-6af4-4cb0-a1a1-899e5a8a8957 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:40.134241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a0b61-2bb8-4c2a-a473-9c6d75395f67 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.167396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ca685-310c-41d2-a45a-a6ce9b102e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.168064 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ca685-310c-41d2-a45a-a6ce9b102e3e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.168350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ca685-310c-41d2-a45a-a6ce9b102e3e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.168630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ca685-310c-41d2-a45a-a6ce9b102e3e None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.169332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ca685-310c-41d2-a45a-a6ce9b102e3e None admin] RBAC: Adding query filter params (name=image) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:40.169645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ca685-310c-41d2-a45a-a6ce9b102e3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:40.171291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ca685-310c-41d2-a45a-a6ce9b102e3e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:40.176135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 543/1054] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:40.181470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ca685-310c-41d2-a45a-a6ce9b102e3e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:40.185042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490797-6af4-4cb0-a1a1-899e5a8a8957 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.219233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd09c0e-9caf-4acc-b5a2-e4905347fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.219908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd09c0e-9caf-4acc-b5a2-e4905347fce3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.220194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd09c0e-9caf-4acc-b5a2-e4905347fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.220550 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd09c0e-9caf-4acc-b5a2-e4905347fce3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.281805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ca685-310c-41d2-a45a-a6ce9b102e3e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.288148 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd09c0e-9caf-4acc-b5a2-e4905347fce3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:40.289852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd09c0e-9caf-4acc-b5a2-e4905347fce3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:40.315236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8956904-7efb-48cb-9c9a-353aeae142a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.315919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8956904-7efb-48cb-9c9a-353aeae142a2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.316210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8956904-7efb-48cb-9c9a-353aeae142a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.317079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8956904-7efb-48cb-9c9a-353aeae142a2 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.317877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8956904-7efb-48cb-9c9a-353aeae142a2 None admin] RBAC: Adding query filter params (type=image) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:40.318090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8956904-7efb-48cb-9c9a-353aeae142a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:40.319497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8956904-7efb-48cb-9c9a-353aeae142a2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:40.324349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 544/1055] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:40.329680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8956904-7efb-48cb-9c9a-353aeae142a2 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:40.386419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 512/1056] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 10 17:12:40.392258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd09c0e-9caf-4acc-b5a2-e4905347fce3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:40.424921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8956904-7efb-48cb-9c9a-353aeae142a2 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.458793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5448b-bb72-4221-9d99-bc7f05b11267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.459445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5448b-bb72-4221-9d99-bc7f05b11267 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.459727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5448b-bb72-4221-9d99-bc7f05b11267 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.460000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5448b-bb72-4221-9d99-bc7f05b11267 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.460729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5448b-bb72-4221-9d99-bc7f05b11267 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:40.462075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5448b-bb72-4221-9d99-bc7f05b11267 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:40.490144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 545/1057] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Mar 10 17:12:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:12:40.490375 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd09c0e-9caf-4acc-b5a2-e4905347fce3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.531295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3df83-c669-4c9f-a6f7-529eead27bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.532194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3df83-c669-4c9f-a6f7-529eead27bdf None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.532477 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3df83-c669-4c9f-a6f7-529eead27bdf None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.532754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3df83-c669-4c9f-a6f7-529eead27bdf None admin] PATH_INFO: `/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.533943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3df83-c669-4c9f-a6f7-529eead27bdf None admin] RBAC: Authorizing `identity:get_project(project_id=2ac0f7c2da91487ea25d2e06d24cb1f1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:40.535444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3df83-c669-4c9f-a6f7-529eead27bdf None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:40.537540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 513/1058] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:12:40 2022] GET /identity/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:40.543607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5448b-bb72-4221-9d99-bc7f05b11267 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:40.582871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e4622-1e93-40ac-9ba2-7fdd35a06030 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.583197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e4622-1e93-40ac-9ba2-7fdd35a06030 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.583426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e4622-1e93-40ac-9ba2-7fdd35a06030 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.585467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 514/1059] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:40.591079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913dc1c-77bb-49a8-9b68-3a6272345c59 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.591368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913dc1c-77bb-49a8-9b68-3a6272345c59 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.591645 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913dc1c-77bb-49a8-9b68-3a6272345c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.608384 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b913dc1c-77bb-49a8-9b68-3a6272345c59 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:40.609582 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b913dc1c-77bb-49a8-9b68-3a6272345c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:40.649821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5448b-bb72-4221-9d99-bc7f05b11267 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.679545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 515/1060] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:40.685692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dedbe-f36c-40f8-b583-26ab3ecd15c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.686391 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dedbe-f36c-40f8-b583-26ab3ecd15c0 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.686682 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dedbe-f36c-40f8-b583-26ab3ecd15c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.686958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dedbe-f36c-40f8-b583-26ab3ecd15c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.687793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dedbe-f36c-40f8-b583-26ab3ecd15c0 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=2ac0f7c2da91487ea25d2e06d24cb1f1, user.id=17d4d2594e69499f99582011674c955e) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:40.688105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dedbe-f36c-40f8-b583-26ab3ecd15c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:40.689537 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dedbe-f36c-40f8-b583-26ab3ecd15c0 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:40.695586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 546/1061] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:40 2022] GET /identity/v3/role_assignments?user.id=17d4d2594e69499f99582011674c955e&scope.project.id=2ac0f7c2da91487ea25d2e06d24cb1f1&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:40.703035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913dc1c-77bb-49a8-9b68-3a6272345c59 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:40.805557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913dc1c-77bb-49a8-9b68-3a6272345c59 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.841703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcc942-7882-4a5d-a37b-2d94d3f983e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.842561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcc942-7882-4a5d-a37b-2d94d3f983e7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:40.842842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcc942-7882-4a5d-a37b-2d94d3f983e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:40.843112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcc942-7882-4a5d-a37b-2d94d3f983e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:40.854030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcc942-7882-4a5d-a37b-2d94d3f983e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:40.861593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-f8bcc942-7882-4a5d-a37b-2d94d3f983e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 17:12:40.863081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 516/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Mar 10 17:12:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:40.869770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dedbe-f36c-40f8-b583-26ab3ecd15c0 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:40.967144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dedbe-f36c-40f8-b583-26ab3ecd15c0 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:40.999143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cabe8f-3a88-4f29-b903-d2c4fb534d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:40.999818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cabe8f-3a88-4f29-b903-d2c4fb534d3a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:41.000105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cabe8f-3a88-4f29-b903-d2c4fb534d3a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:41.000387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cabe8f-3a88-4f29-b903-d2c4fb534d3a None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:41.001125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cabe8f-3a88-4f29-b903-d2c4fb534d3a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:41.001434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cabe8f-3a88-4f29-b903-d2c4fb534d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:41.002821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cabe8f-3a88-4f29-b903-d2c4fb534d3a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:41.015069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 547/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Mar 10 17:12:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:41.016308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcc942-7882-4a5d-a37b-2d94d3f983e7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:41.110643 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcc942-7882-4a5d-a37b-2d94d3f983e7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:41.142294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db40930-b4cf-4ccd-ac99-699a8173721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:41.143082 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db40930-b4cf-4ccd-ac99-699a8173721f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:41.143361 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db40930-b4cf-4ccd-ac99-699a8173721f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:41.143633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db40930-b4cf-4ccd-ac99-699a8173721f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:41.153376 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db40930-b4cf-4ccd-ac99-699a8173721f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:41.154829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db40930-b4cf-4ccd-ac99-699a8173721f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:41.171169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-3db40930-b4cf-4ccd-ac99-699a8173721f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:41.172787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 517/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:41.178765 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cabe8f-3a88-4f29-b903-d2c4fb534d3a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:41.274041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cabe8f-3a88-4f29-b903-d2c4fb534d3a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:41.307485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3c246-384a-40d0-9a85-289110c9f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:41.308154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3c246-384a-40d0-9a85-289110c9f03a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:41.308436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3c246-384a-40d0-9a85-289110c9f03a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:41.308708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3c246-384a-40d0-9a85-289110c9f03a None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:41.309479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3c246-384a-40d0-9a85-289110c9f03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:41.309789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3c246-384a-40d0-9a85-289110c9f03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:41.311175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3c246-384a-40d0-9a85-289110c9f03a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:41.323003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 548/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:41.328605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db40930-b4cf-4ccd-ac99-699a8173721f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:41.423986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db40930-b4cf-4ccd-ac99-699a8173721f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:41.455298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64af4e-40d5-4127-9be9-89d6ab848108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:41.456075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64af4e-40d5-4127-9be9-89d6ab848108 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:41.456355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64af4e-40d5-4127-9be9-89d6ab848108 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:41.456625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64af4e-40d5-4127-9be9-89d6ab848108 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:41.464271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64af4e-40d5-4127-9be9-89d6ab848108 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:41.465691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64af4e-40d5-4127-9be9-89d6ab848108 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:41.479327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-8a64af4e-40d5-4127-9be9-89d6ab848108 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 17:12:41.480659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 518/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Mar 10 17:12:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:41.486164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3c246-384a-40d0-9a85-289110c9f03a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:41.580255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3c246-384a-40d0-9a85-289110c9f03a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:41.612522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa55c-8537-44da-818b-edaee9605181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:41.613207 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa55c-8537-44da-818b-edaee9605181 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:41.613492 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa55c-8537-44da-818b-edaee9605181 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:41.613763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa55c-8537-44da-818b-edaee9605181 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:41.614611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa55c-8537-44da-818b-edaee9605181 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:41.614917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa55c-8537-44da-818b-edaee9605181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:41.616318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa55c-8537-44da-818b-edaee9605181 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:41.636810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 549/1067] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Mar 10 17:12:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:41.638464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64af4e-40d5-4127-9be9-89d6ab848108 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:41.734606 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64af4e-40d5-4127-9be9-89d6ab848108 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:41.765848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f064729-61e3-44e2-bd0a-936dbcc68f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:41.766663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f064729-61e3-44e2-bd0a-936dbcc68f8e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:41.766944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f064729-61e3-44e2-bd0a-936dbcc68f8e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:41.767216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f064729-61e3-44e2-bd0a-936dbcc68f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:41.777225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f064729-61e3-44e2-bd0a-936dbcc68f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:41.778931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f064729-61e3-44e2-bd0a-936dbcc68f8e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:41.794888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-9f064729-61e3-44e2-bd0a-936dbcc68f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:41.796454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 519/1068] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:41.802015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa55c-8537-44da-818b-edaee9605181 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:41.897416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa55c-8537-44da-818b-edaee9605181 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:41.929140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192db1b9-e09b-4cbb-b0e9-5acd8f076961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:41.930146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192db1b9-e09b-4cbb-b0e9-5acd8f076961 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:41.930697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192db1b9-e09b-4cbb-b0e9-5acd8f076961 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:41.931171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192db1b9-e09b-4cbb-b0e9-5acd8f076961 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:41.932087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192db1b9-e09b-4cbb-b0e9-5acd8f076961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:41.932587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192db1b9-e09b-4cbb-b0e9-5acd8f076961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:41.934145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192db1b9-e09b-4cbb-b0e9-5acd8f076961 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:41.945814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 550/1069] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:41.951244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f064729-61e3-44e2-bd0a-936dbcc68f8e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:42.043827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f064729-61e3-44e2-bd0a-936dbcc68f8e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:42.075443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc15a6-2600-4a68-879d-17a7c086ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:42.076226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc15a6-2600-4a68-879d-17a7c086ab80 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:42.076505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc15a6-2600-4a68-879d-17a7c086ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:42.076777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc15a6-2600-4a68-879d-17a7c086ab80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:42.083553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc15a6-2600-4a68-879d-17a7c086ab80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:42.084970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc15a6-2600-4a68-879d-17a7c086ab80 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:42.098514 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-edbc15a6-2600-4a68-879d-17a7c086ab80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:42.099889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 520/1070] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:42.105364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192db1b9-e09b-4cbb-b0e9-5acd8f076961 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:42.199713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192db1b9-e09b-4cbb-b0e9-5acd8f076961 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:42.231779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8cfb1-32d1-416b-86d2-f048231e1385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:42.232444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8cfb1-32d1-416b-86d2-f048231e1385 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:42.232723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8cfb1-32d1-416b-86d2-f048231e1385 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:42.232993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8cfb1-32d1-416b-86d2-f048231e1385 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:42.233763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8cfb1-32d1-416b-86d2-f048231e1385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:42.234067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8cfb1-32d1-416b-86d2-f048231e1385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:42.235512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8cfb1-32d1-416b-86d2-f048231e1385 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:42.247473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 551/1071] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:42.253079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc15a6-2600-4a68-879d-17a7c086ab80 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:42.355309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc15a6-2600-4a68-879d-17a7c086ab80 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:42.387435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed241bd-8bdf-43fb-9583-12d91575e9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:42.388309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed241bd-8bdf-43fb-9583-12d91575e9f6 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:42.388588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed241bd-8bdf-43fb-9583-12d91575e9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:42.388858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed241bd-8bdf-43fb-9583-12d91575e9f6 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/89a64b4a57114f77a231a31e16b3923e/roles/34c5fd7c7f2f45e7811bfab9ccd5f806` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:42.391036 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed241bd-8bdf-43fb-9583-12d91575e9f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=89a64b4a57114f77a231a31e16b3923e, role_id=34c5fd7c7f2f45e7811bfab9ccd5f806)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:42.392451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed241bd-8bdf-43fb-9583-12d91575e9f6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:42.406249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 521/1072] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:12:42 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/89a64b4a57114f77a231a31e16b3923e/roles/34c5fd7c7f2f45e7811bfab9ccd5f806 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:12:42.833257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bf92f-e74f-456d-a10e-54b1e3c05894 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:42.833778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bf92f-e74f-456d-a10e-54b1e3c05894 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:42.833855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bf92f-e74f-456d-a10e-54b1e3c05894 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:42.836422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 552/1073] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:42.844886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114e16-361b-449f-b36d-18a061df4bda None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:42.845361 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114e16-361b-449f-b36d-18a061df4bda None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:42.845462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114e16-361b-449f-b36d-18a061df4bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:42.864852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ba114e16-361b-449f-b36d-18a061df4bda None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:42.866016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ba114e16-361b-449f-b36d-18a061df4bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:42.929053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 522/1074] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:42.951191 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bf92f-e74f-456d-a10e-54b1e3c05894 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:42.993542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3c5b-3e89-414e-872d-c7749b0464ae None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:42.993855 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3c5b-3e89-414e-872d-c7749b0464ae None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:42.994132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3c5b-3e89-414e-872d-c7749b0464ae None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:42.996588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 523/1075] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:43.001053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9171f-81bb-4019-b841-9b93824198be None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:43.001342 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9171f-81bb-4019-b841-9b93824198be None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:43.001622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9171f-81bb-4019-b841-9b93824198be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:43.019289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-dcd9171f-81bb-4019-b841-9b93824198be None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:43.020452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-dcd9171f-81bb-4019-b841-9b93824198be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:43.047898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bf92f-e74f-456d-a10e-54b1e3c05894 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:43.080838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c499eda-ac78-4cca-8017-e0651b40d106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:43.081475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c499eda-ac78-4cca-8017-e0651b40d106 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:43.081761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c499eda-ac78-4cca-8017-e0651b40d106 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:43.082063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c499eda-ac78-4cca-8017-e0651b40d106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:43.086251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 524/1076] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:43.106095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9171f-81bb-4019-b841-9b93824198be None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:43.147858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c499eda-ac78-4cca-8017-e0651b40d106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:43.149322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c499eda-ac78-4cca-8017-e0651b40d106 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:43.202157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9171f-81bb-4019-b841-9b93824198be None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:43.236396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8336e8-57a8-4d6c-9985-51db72809863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:43.237187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8336e8-57a8-4d6c-9985-51db72809863 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:43.237468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8336e8-57a8-4d6c-9985-51db72809863 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:43.237790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8336e8-57a8-4d6c-9985-51db72809863 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:43.248297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8336e8-57a8-4d6c-9985-51db72809863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:43.255221 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-ed8336e8-57a8-4d6c-9985-51db72809863 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:12:43.256615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 525/1077] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:12:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:43.258346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 553/1078] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 10 17:12:43.262270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8336e8-57a8-4d6c-9985-51db72809863 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:43.263863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c499eda-ac78-4cca-8017-e0651b40d106 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:43.362242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8336e8-57a8-4d6c-9985-51db72809863 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:43.362780 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c499eda-ac78-4cca-8017-e0651b40d106 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:43.394818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6e246-d993-4324-bd93-bdc76c369642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:43.395462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdddf7-cb58-44a7-89f4-b54f7c9bc4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:43.395650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6e246-d993-4324-bd93-bdc76c369642 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:43.395895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6e246-d993-4324-bd93-bdc76c369642 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:43.396145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdddf7-cb58-44a7-89f4-b54f7c9bc4b1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:43.396250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6e246-d993-4324-bd93-bdc76c369642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:43.396424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdddf7-cb58-44a7-89f4-b54f7c9bc4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:43.396692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdddf7-cb58-44a7-89f4-b54f7c9bc4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:43.397425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdddf7-cb58-44a7-89f4-b54f7c9bc4b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:43.397725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdddf7-cb58-44a7-89f4-b54f7c9bc4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:43.399105 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdddf7-cb58-44a7-89f4-b54f7c9bc4b1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:43.405936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6e246-d993-4324-bd93-bdc76c369642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:43.407517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6e246-d993-4324-bd93-bdc76c369642 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:43.412348 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 526/1079] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:43.413303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdddf7-cb58-44a7-89f4-b54f7c9bc4b1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:43.424663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-dea6e246-d993-4324-bd93-bdc76c369642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:43.426673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 554/1080] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:43.431953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6e246-d993-4324-bd93-bdc76c369642 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:43.508597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdddf7-cb58-44a7-89f4-b54f7c9bc4b1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:43.530493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6e246-d993-4324-bd93-bdc76c369642 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:43.542879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3916b-ed11-4033-b117-c655b43537a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:43.543777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3916b-ed11-4033-b117-c655b43537a0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:43.544050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3916b-ed11-4033-b117-c655b43537a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:43.544320 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3916b-ed11-4033-b117-c655b43537a0 None admin] PATH_INFO: `/v3/users/17d4d2594e69499f99582011674c955e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:43.545836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3916b-ed11-4033-b117-c655b43537a0 None admin] RBAC: Authorizing `identity:get_user(user_id=17d4d2594e69499f99582011674c955e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:43.547497 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3916b-ed11-4033-b117-c655b43537a0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:43.549125 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 527/1081] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:12:43 2022] GET /identity/v3/users/17d4d2594e69499f99582011674c955e => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:43.555371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3916b-ed11-4033-b117-c655b43537a0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:43.573580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb15e1a-0e08-4667-b7c1-9afc673e7600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:43.574278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15e1a-0e08-4667-b7c1-9afc673e7600 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:43.574562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15e1a-0e08-4667-b7c1-9afc673e7600 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:43.574830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15e1a-0e08-4667-b7c1-9afc673e7600 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:43.575542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb15e1a-0e08-4667-b7c1-9afc673e7600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:43.575844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb15e1a-0e08-4667-b7c1-9afc673e7600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:43.577201 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb15e1a-0e08-4667-b7c1-9afc673e7600 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:43.598140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 555/1082] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:43.671546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3916b-ed11-4033-b117-c655b43537a0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:43.704919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec31281-e28f-43a1-ab82-8528fae6f41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:43.705796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec31281-e28f-43a1-ab82-8528fae6f41f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:43.706073 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec31281-e28f-43a1-ab82-8528fae6f41f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:43.706373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec31281-e28f-43a1-ab82-8528fae6f41f None admin] PATH_INFO: `/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:43.708193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec31281-e28f-43a1-ab82-8528fae6f41f None admin] RBAC: Authorizing `identity:get_project(project_id=2ac0f7c2da91487ea25d2e06d24cb1f1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:43.709637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec31281-e28f-43a1-ab82-8528fae6f41f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:43.711396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 528/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:12:43 2022] GET /identity/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:43.717494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb15e1a-0e08-4667-b7c1-9afc673e7600 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:43.821002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb15e1a-0e08-4667-b7c1-9afc673e7600 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:43.856018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b539a4-8ec2-4e4c-ae21-44a8c5b3b0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:43.856902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b539a4-8ec2-4e4c-ae21-44a8c5b3b0e9 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:43.857184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b539a4-8ec2-4e4c-ae21-44a8c5b3b0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:43.857456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b539a4-8ec2-4e4c-ae21-44a8c5b3b0e9 None admin] PATH_INFO: `/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1/users/17d4d2594e69499f99582011674c955e/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:43.859485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b539a4-8ec2-4e4c-ae21-44a8c5b3b0e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ac0f7c2da91487ea25d2e06d24cb1f1, user_id=17d4d2594e69499f99582011674c955e, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:43.860915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b539a4-8ec2-4e4c-ae21-44a8c5b3b0e9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:43.876382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 556/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:12:43 2022] PUT /identity/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1/users/17d4d2594e69499f99582011674c955e/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:12:44.781626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7ddf-4a0b-45b6-9173-2ddaeda19fba None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:44.782192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7ddf-4a0b-45b6-9173-2ddaeda19fba None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:44.782192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7ddf-4a0b-45b6-9173-2ddaeda19fba None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:44.783966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 529/1085] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:44.789589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d6e81-d269-4e1a-bf0b-270ffa56aec0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:44.789889 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d6e81-d269-4e1a-bf0b-270ffa56aec0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:44.790204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d6e81-d269-4e1a-bf0b-270ffa56aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:44.807471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-720d6e81-d269-4e1a-bf0b-270ffa56aec0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:44.809109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-720d6e81-d269-4e1a-bf0b-270ffa56aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:44.871980 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 557/1086] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:44.895093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7ddf-4a0b-45b6-9173-2ddaeda19fba None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:44.991573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7ddf-4a0b-45b6-9173-2ddaeda19fba None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:45.023411 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c30c-347c-49a2-aec8-930fa120238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:45.024232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c30c-347c-49a2-aec8-930fa120238f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:45.024508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c30c-347c-49a2-aec8-930fa120238f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:45.024777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c30c-347c-49a2-aec8-930fa120238f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:45.034288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c30c-347c-49a2-aec8-930fa120238f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:45.041913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-1ba0c30c-347c-49a2-aec8-930fa120238f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 17:12:45.043080 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 530/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Mar 10 17:12:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:45.049336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d6e81-d269-4e1a-bf0b-270ffa56aec0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:45.141579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d6e81-d269-4e1a-bf0b-270ffa56aec0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:45.173876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a361b34-5e34-4042-9e49-fc7636de5a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:45.174569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a361b34-5e34-4042-9e49-fc7636de5a2c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:45.174859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a361b34-5e34-4042-9e49-fc7636de5a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:45.175136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a361b34-5e34-4042-9e49-fc7636de5a2c None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:45.177440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a361b34-5e34-4042-9e49-fc7636de5a2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:45.177757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a361b34-5e34-4042-9e49-fc7636de5a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:45.182460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a361b34-5e34-4042-9e49-fc7636de5a2c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:45.190691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 558/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Mar 10 17:12:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:45.196548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c30c-347c-49a2-aec8-930fa120238f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:45.291388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c30c-347c-49a2-aec8-930fa120238f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:45.326192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a0c16-c21b-488e-8b9a-3568e868a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:45.326978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0c16-c21b-488e-8b9a-3568e868a406 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:45.327257 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0c16-c21b-488e-8b9a-3568e868a406 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:45.327525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0c16-c21b-488e-8b9a-3568e868a406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:45.338478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0c16-c21b-488e-8b9a-3568e868a406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:45.339896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0c16-c21b-488e-8b9a-3568e868a406 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:45.356226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-742a0c16-c21b-488e-8b9a-3568e868a406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:45.357369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 531/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:45.363162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a361b34-5e34-4042-9e49-fc7636de5a2c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:45.458550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a361b34-5e34-4042-9e49-fc7636de5a2c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:45.490266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14afb9a-85f9-4b82-927a-8c6ab2e270ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:45.490935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14afb9a-85f9-4b82-927a-8c6ab2e270ba None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:45.491226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14afb9a-85f9-4b82-927a-8c6ab2e270ba None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:45.491503 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14afb9a-85f9-4b82-927a-8c6ab2e270ba None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:45.492213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14afb9a-85f9-4b82-927a-8c6ab2e270ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:45.492518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14afb9a-85f9-4b82-927a-8c6ab2e270ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:45.493871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14afb9a-85f9-4b82-927a-8c6ab2e270ba None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:45.505658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 559/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:45.511456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a0c16-c21b-488e-8b9a-3568e868a406 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:45.610521 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a0c16-c21b-488e-8b9a-3568e868a406 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:45.642631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a57c9-8135-4a88-a01b-600b48f51a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:45.643408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a57c9-8135-4a88-a01b-600b48f51a01 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:45.643686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a57c9-8135-4a88-a01b-600b48f51a01 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:45.643957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a57c9-8135-4a88-a01b-600b48f51a01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:45.651921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a57c9-8135-4a88-a01b-600b48f51a01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:45.653356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a57c9-8135-4a88-a01b-600b48f51a01 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:45.666755 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-bf5a57c9-8135-4a88-a01b-600b48f51a01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 17:12:45.667909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 532/1091] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Mar 10 17:12:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:45.673949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14afb9a-85f9-4b82-927a-8c6ab2e270ba None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:45.770555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14afb9a-85f9-4b82-927a-8c6ab2e270ba None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:45.802721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f7e6e-5c54-4647-9a3b-d4e7a99589b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:45.803387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f7e6e-5c54-4647-9a3b-d4e7a99589b9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:45.803669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f7e6e-5c54-4647-9a3b-d4e7a99589b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:45.803943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f7e6e-5c54-4647-9a3b-d4e7a99589b9 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:45.804760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f7e6e-5c54-4647-9a3b-d4e7a99589b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:45.805067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f7e6e-5c54-4647-9a3b-d4e7a99589b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:45.806608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f7e6e-5c54-4647-9a3b-d4e7a99589b9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:45.824706 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 560/1092] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Mar 10 17:12:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:45.830351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a57c9-8135-4a88-a01b-600b48f51a01 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:45.930664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a57c9-8135-4a88-a01b-600b48f51a01 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:45.962005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1a237-f38f-44eb-9ad7-8b14868cf6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:45.962665 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1a237-f38f-44eb-9ad7-8b14868cf6e2 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:45.962947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1a237-f38f-44eb-9ad7-8b14868cf6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:45.963220 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1a237-f38f-44eb-9ad7-8b14868cf6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.025070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1a237-f38f-44eb-9ad7-8b14868cf6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:46.026538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1a237-f38f-44eb-9ad7-8b14868cf6e2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:46.116601 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 533/1093] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 10 17:12:46.122098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f7e6e-5c54-4647-9a3b-d4e7a99589b9 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:46.215965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f7e6e-5c54-4647-9a3b-d4e7a99589b9 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:46.229076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca0137-65c4-455a-a8a0-d58c1a0634e5 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.229368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca0137-65c4-455a-a8a0-d58c1a0634e5 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.229652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca0137-65c4-455a-a8a0-d58c1a0634e5 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.231608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 534/1094] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:12:46.236202 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ece3-8377-47aa-a99b-e8becd9e9194 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.236491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ece3-8377-47aa-a99b-e8becd9e9194 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.236773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ece3-8377-47aa-a99b-e8becd9e9194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.248872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ee03-ff62-407f-94fe-c373ce53fe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:46.249661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ee03-ff62-407f-94fe-c373ce53fe83 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.249946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ee03-ff62-407f-94fe-c373ce53fe83 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.250268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ee03-ff62-407f-94fe-c373ce53fe83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.254083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-5716ece3-8377-47aa-a99b-e8becd9e9194 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:46.255281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5716ece3-8377-47aa-a99b-e8becd9e9194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:46.259790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826ee03-ff62-407f-94fe-c373ce53fe83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:46.261218 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826ee03-ff62-407f-94fe-c373ce53fe83 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:46.277220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-c826ee03-ff62-407f-94fe-c373ce53fe83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:12:46.278400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 561/1095] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:12:46.283967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ee03-ff62-407f-94fe-c373ce53fe83 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:46.320790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 535/1096] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:46.343970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716ece3-8377-47aa-a99b-e8becd9e9194 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:46.376959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ee03-ff62-407f-94fe-c373ce53fe83 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:46.408758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784be66-10f2-4b73-9bb5-24b8b6c95218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:46.409411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784be66-10f2-4b73-9bb5-24b8b6c95218 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.409695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784be66-10f2-4b73-9bb5-24b8b6c95218 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.409996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784be66-10f2-4b73-9bb5-24b8b6c95218 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.410734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784be66-10f2-4b73-9bb5-24b8b6c95218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:46.411036 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784be66-10f2-4b73-9bb5-24b8b6c95218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:46.412377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784be66-10f2-4b73-9bb5-24b8b6c95218 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:46.423129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 562/1097] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:46.428591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784be66-10f2-4b73-9bb5-24b8b6c95218 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:46.435807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716ece3-8377-47aa-a99b-e8becd9e9194 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:46.468588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb78580-3e56-4ddc-9555-8e608c68d706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:46.469305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb78580-3e56-4ddc-9555-8e608c68d706 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.469583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb78580-3e56-4ddc-9555-8e608c68d706 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.469858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb78580-3e56-4ddc-9555-8e608c68d706 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.479493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb78580-3e56-4ddc-9555-8e608c68d706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:12:46.486273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-8eb78580-3e56-4ddc-9555-8e608c68d706 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:12:46.487412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 536/1098] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:46.493292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb78580-3e56-4ddc-9555-8e608c68d706 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:46.523573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784be66-10f2-4b73-9bb5-24b8b6c95218 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:46.554766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753a6bc-585f-4d5a-b684-9abd3987ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:46.555552 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753a6bc-585f-4d5a-b684-9abd3987ff74 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.555827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753a6bc-585f-4d5a-b684-9abd3987ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.556101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753a6bc-585f-4d5a-b684-9abd3987ff74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.562396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753a6bc-585f-4d5a-b684-9abd3987ff74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:46.563810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753a6bc-585f-4d5a-b684-9abd3987ff74 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:46.577205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-5753a6bc-585f-4d5a-b684-9abd3987ff74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:12:46.578380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 563/1099] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:12:46.584547 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753a6bc-585f-4d5a-b684-9abd3987ff74 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:46.586773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb78580-3e56-4ddc-9555-8e608c68d706 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:46.618434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b8701-927d-4c7c-adbb-99bee29d2564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:46.619091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b8701-927d-4c7c-adbb-99bee29d2564 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.619375 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b8701-927d-4c7c-adbb-99bee29d2564 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.619652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b8701-927d-4c7c-adbb-99bee29d2564 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.620390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b8701-927d-4c7c-adbb-99bee29d2564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:46.620696 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b8701-927d-4c7c-adbb-99bee29d2564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:46.622058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b8701-927d-4c7c-adbb-99bee29d2564 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:46.630393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 537/1100] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:46.635987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b8701-927d-4c7c-adbb-99bee29d2564 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:46.676122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753a6bc-585f-4d5a-b684-9abd3987ff74 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:46.707589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eadde-8127-4fa5-8ce4-d0df7d386e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:46.708237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eadde-8127-4fa5-8ce4-d0df7d386e5e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.708521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eadde-8127-4fa5-8ce4-d0df7d386e5e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.708796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eadde-8127-4fa5-8ce4-d0df7d386e5e None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.709566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eadde-8127-4fa5-8ce4-d0df7d386e5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:46.709870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eadde-8127-4fa5-8ce4-d0df7d386e5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:46.711301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eadde-8127-4fa5-8ce4-d0df7d386e5e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:46.722083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 564/1101] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:46.727941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eadde-8127-4fa5-8ce4-d0df7d386e5e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:46.728106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b8701-927d-4c7c-adbb-99bee29d2564 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:46.760402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b77a10-612c-4984-86c3-d1e7a4db4a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:46.761252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b77a10-612c-4984-86c3-d1e7a4db4a3e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.761530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b77a10-612c-4984-86c3-d1e7a4db4a3e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.761805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b77a10-612c-4984-86c3-d1e7a4db4a3e None admin] PATH_INFO: `/v3/users/17d4d2594e69499f99582011674c955e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.763042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b77a10-612c-4984-86c3-d1e7a4db4a3e None admin] RBAC: Authorizing `identity:get_user(user_id=17d4d2594e69499f99582011674c955e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:46.764491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b77a10-612c-4984-86c3-d1e7a4db4a3e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:46.766094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 538/1102] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:12:46 2022] GET /identity/v3/users/17d4d2594e69499f99582011674c955e => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:46.771735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b77a10-612c-4984-86c3-d1e7a4db4a3e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:46.820698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eadde-8127-4fa5-8ce4-d0df7d386e5e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:46.851430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48556-8e13-4a82-ba77-7b46e76f7fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:46.852071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48556-8e13-4a82-ba77-7b46e76f7fc2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.852353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48556-8e13-4a82-ba77-7b46e76f7fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.852627 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48556-8e13-4a82-ba77-7b46e76f7fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.853432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48556-8e13-4a82-ba77-7b46e76f7fc2 None admin] RBAC: Adding query filter params (role.id=34c5fd7c7f2f45e7811bfab9ccd5f806, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=89a64b4a57114f77a231a31e16b3923e) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:46.853737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48556-8e13-4a82-ba77-7b46e76f7fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:46.855172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48556-8e13-4a82-ba77-7b46e76f7fc2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:46.860882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 565/1103] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:46 2022] GET /identity/v3/role_assignments?user.id=89a64b4a57114f77a231a31e16b3923e&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=34c5fd7c7f2f45e7811bfab9ccd5f806 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:46.864412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b77a10-612c-4984-86c3-d1e7a4db4a3e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:46.899965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6575b-207c-4f1c-ad73-f3734c952d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:46.901128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6575b-207c-4f1c-ad73-f3734c952d6a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:46.901567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6575b-207c-4f1c-ad73-f3734c952d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:46.901856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6575b-207c-4f1c-ad73-f3734c952d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:46.974711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6575b-207c-4f1c-ad73-f3734c952d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:46.976097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6575b-207c-4f1c-ad73-f3734c952d6a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:47.074553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 539/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 10 17:12:47.080339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48556-8e13-4a82-ba77-7b46e76f7fc2 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:47.177649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48556-8e13-4a82-ba77-7b46e76f7fc2 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:47.209651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5075d64-9547-4033-a500-c116f228c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:47.210544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5075d64-9547-4033-a500-c116f228c0bf None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:47.210827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5075d64-9547-4033-a500-c116f228c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:47.211104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5075d64-9547-4033-a500-c116f228c0bf None admin] PATH_INFO: `/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:47.212282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5075d64-9547-4033-a500-c116f228c0bf None admin] RBAC: Authorizing `identity:get_project(project_id=2ac0f7c2da91487ea25d2e06d24cb1f1)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:47.213706 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5075d64-9547-4033-a500-c116f228c0bf None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:47.215414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 566/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:12:47 2022] GET /identity/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:47.221616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6575b-207c-4f1c-ad73-f3734c952d6a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:47.329023 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6575b-207c-4f1c-ad73-f3734c952d6a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:47.362084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde7b6d-95a9-443a-9df2-83c2fcff7911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:47.362796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde7b6d-95a9-443a-9df2-83c2fcff7911 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:47.363683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde7b6d-95a9-443a-9df2-83c2fcff7911 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:47.363965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde7b6d-95a9-443a-9df2-83c2fcff7911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:47.364793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde7b6d-95a9-443a-9df2-83c2fcff7911 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=2ac0f7c2da91487ea25d2e06d24cb1f1, user.id=17d4d2594e69499f99582011674c955e) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:47.365097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde7b6d-95a9-443a-9df2-83c2fcff7911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:47.366558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde7b6d-95a9-443a-9df2-83c2fcff7911 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:47.372211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 540/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:47 2022] GET /identity/v3/role_assignments?user.id=17d4d2594e69499f99582011674c955e&scope.project.id=2ac0f7c2da91487ea25d2e06d24cb1f1&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:49.689967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4cc6-3458-4603-861f-de312479694a None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:49.690501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4cc6-3458-4603-861f-de312479694a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:49.690612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4cc6-3458-4603-861f-de312479694a None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:49.692361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 567/1107] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:49.697507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914a4a7-a7d5-4562-ae89-707add5bc936 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:49.697933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914a4a7-a7d5-4562-ae89-707add5bc936 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:49.698051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914a4a7-a7d5-4562-ae89-707add5bc936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:49.714655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1914a4a7-a7d5-4562-ae89-707add5bc936 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:49.715799 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1914a4a7-a7d5-4562-ae89-707add5bc936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:49.776911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 541/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:49.801869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab4cc6-3458-4603-861f-de312479694a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:49.900012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab4cc6-3458-4603-861f-de312479694a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:49.931440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7704d5-62d9-44c5-8069-fcb69eb6ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:49.932219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7704d5-62d9-44c5-8069-fcb69eb6ce16 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:49.932502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7704d5-62d9-44c5-8069-fcb69eb6ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:49.932778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7704d5-62d9-44c5-8069-fcb69eb6ce16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:49.933928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7704d5-62d9-44c5-8069-fcb69eb6ce16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:49.935362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7704d5-62d9-44c5-8069-fcb69eb6ce16 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:49.936936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 568/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:12:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:49.942798 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914a4a7-a7d5-4562-ae89-707add5bc936 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:50.032686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914a4a7-a7d5-4562-ae89-707add5bc936 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:50.063486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e3dbe-8f5c-4f6b-9f78-36423207e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:50.064128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3dbe-8f5c-4f6b-9f78-36423207e64c None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:50.064407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3dbe-8f5c-4f6b-9f78-36423207e64c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:50.064677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3dbe-8f5c-4f6b-9f78-36423207e64c None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:50.065404 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e3dbe-8f5c-4f6b-9f78-36423207e64c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:50.067416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e3dbe-8f5c-4f6b-9f78-36423207e64c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:50.087122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 542/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:12:49 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:12:52.407605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af46f-cd4e-48b4-ad86-3e2a41b8b8da None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:52.408131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af46f-cd4e-48b4-ad86-3e2a41b8b8da None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:52.408232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af46f-cd4e-48b4-ad86-3e2a41b8b8da None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:52.410479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 569/1111] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:52.415665 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43e621-6b17-45fd-a914-5adc7f6366ff None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:52.416059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43e621-6b17-45fd-a914-5adc7f6366ff None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:52.416226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43e621-6b17-45fd-a914-5adc7f6366ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:52.433368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2c43e621-6b17-45fd-a914-5adc7f6366ff None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:52.434574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2c43e621-6b17-45fd-a914-5adc7f6366ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:52.497356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 543/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:52.520308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9af46f-cd4e-48b4-ad86-3e2a41b8b8da None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:52.615982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9af46f-cd4e-48b4-ad86-3e2a41b8b8da None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:52.647538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704e64-9999-4609-978f-9c314b3cfb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:52.648370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704e64-9999-4609-978f-9c314b3cfb0d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:52.648656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704e64-9999-4609-978f-9c314b3cfb0d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:52.648931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704e64-9999-4609-978f-9c314b3cfb0d None admin] PATH_INFO: `/v3/roles/59b67f94d2af48b08b7bef41a8396bfb` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:52.650420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff704e64-9999-4609-978f-9c314b3cfb0d None admin] RBAC: Authorizing `identity:get_role(role_id=59b67f94d2af48b08b7bef41a8396bfb)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:52.651772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff704e64-9999-4609-978f-9c314b3cfb0d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:52.653101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 570/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:12:52 2022] GET /identity/v3/roles/59b67f94d2af48b08b7bef41a8396bfb => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:52.658611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43e621-6b17-45fd-a914-5adc7f6366ff None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:52.751370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43e621-6b17-45fd-a914-5adc7f6366ff None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:52.782821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb3669-1fe9-4aea-a2c3-69bd1844de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:52.783677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb3669-1fe9-4aea-a2c3-69bd1844de85 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:52.783961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb3669-1fe9-4aea-a2c3-69bd1844de85 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:52.784240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb3669-1fe9-4aea-a2c3-69bd1844de85 None admin] PATH_INFO: `/v3/users/4b6eb9e833064d3d8e0744bf62655167` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:52.797454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb3669-1fe9-4aea-a2c3-69bd1844de85 None admin] RBAC: Authorizing `identity:get_user(user_id=4b6eb9e833064d3d8e0744bf62655167)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:52.798905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb3669-1fe9-4aea-a2c3-69bd1844de85 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:52.800547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 544/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:12:52 2022] GET /identity/v3/users/4b6eb9e833064d3d8e0744bf62655167 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:52.806297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704e64-9999-4609-978f-9c314b3cfb0d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:52.900080 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704e64-9999-4609-978f-9c314b3cfb0d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:52.933793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8c89c-976f-4096-a615-d4d39a7b4dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:52.934467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8c89c-976f-4096-a615-d4d39a7b4dfb None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:52.934754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8c89c-976f-4096-a615-d4d39a7b4dfb None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:52.935032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8c89c-976f-4096-a615-d4d39a7b4dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:52.996764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8c89c-976f-4096-a615-d4d39a7b4dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:52.998207 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8c89c-976f-4096-a615-d4d39a7b4dfb None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:53.088539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 571/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:12:53.094380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb3669-1fe9-4aea-a2c3-69bd1844de85 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:53.185854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb3669-1fe9-4aea-a2c3-69bd1844de85 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:53.218235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc013-6cdd-4a6b-b18d-38636f83161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:53.219081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc013-6cdd-4a6b-b18d-38636f83161d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:53.219360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc013-6cdd-4a6b-b18d-38636f83161d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:53.219627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc013-6cdd-4a6b-b18d-38636f83161d None admin] PATH_INFO: `/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:53.220781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cc013-6cdd-4a6b-b18d-38636f83161d None admin] RBAC: Authorizing `identity:get_project(project_id=2ac0f7c2da91487ea25d2e06d24cb1f1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:53.222735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cc013-6cdd-4a6b-b18d-38636f83161d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:53.224397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 545/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:12:53 2022] GET /identity/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:53.230455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8c89c-976f-4096-a615-d4d39a7b4dfb None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:53.323856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8c89c-976f-4096-a615-d4d39a7b4dfb None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:53.355203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1c8c9-f0fb-47f8-93aa-534a0d1212cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:53.355848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c8c9-f0fb-47f8-93aa-534a0d1212cd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:53.356130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c8c9-f0fb-47f8-93aa-534a0d1212cd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:53.356404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c8c9-f0fb-47f8-93aa-534a0d1212cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:53.357215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1c8c9-f0fb-47f8-93aa-534a0d1212cd None admin] RBAC: Adding query filter params (role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=2ac0f7c2da91487ea25d2e06d24cb1f1, user.id=4b6eb9e833064d3d8e0744bf62655167) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:53.357524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1c8c9-f0fb-47f8-93aa-534a0d1212cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:53.358974 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1c8c9-f0fb-47f8-93aa-534a0d1212cd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:53.364666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 572/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:53 2022] GET /identity/v3/role_assignments?user.id=4b6eb9e833064d3d8e0744bf62655167&scope.project.id=2ac0f7c2da91487ea25d2e06d24cb1f1&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:55.600453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426474-32c3-4bc9-b0ef-23fc24469034 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:55.600952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426474-32c3-4bc9-b0ef-23fc24469034 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:55.600952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426474-32c3-4bc9-b0ef-23fc24469034 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:55.602730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 546/1118] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:55.607914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235dcf5-9479-46f4-9107-6f8db5363d59 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:55.608319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235dcf5-9479-46f4-9107-6f8db5363d59 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:55.608472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235dcf5-9479-46f4-9107-6f8db5363d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:55.625052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-5235dcf5-9479-46f4-9107-6f8db5363d59 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:55.626243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-5235dcf5-9479-46f4-9107-6f8db5363d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:55.687863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 573/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:12:55.710226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426474-32c3-4bc9-b0ef-23fc24469034 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:55.804072 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426474-32c3-4bc9-b0ef-23fc24469034 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:55.836133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4817b9c-af18-4aff-a34f-bf81a705840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:55.836968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817b9c-af18-4aff-a34f-bf81a705840b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:55.837248 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817b9c-af18-4aff-a34f-bf81a705840b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:55.837521 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817b9c-af18-4aff-a34f-bf81a705840b None admin] PATH_INFO: `/v3/roles/59b67f94d2af48b08b7bef41a8396bfb` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:55.838990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4817b9c-af18-4aff-a34f-bf81a705840b None admin] RBAC: Authorizing `identity:get_role(role_id=59b67f94d2af48b08b7bef41a8396bfb)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:55.840354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4817b9c-af18-4aff-a34f-bf81a705840b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:55.841685 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 547/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:12:55 2022] GET /identity/v3/roles/59b67f94d2af48b08b7bef41a8396bfb => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:55.847467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235dcf5-9479-46f4-9107-6f8db5363d59 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:55.939215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235dcf5-9479-46f4-9107-6f8db5363d59 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:55.970556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174c96-8713-41c7-b67d-4015f761059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:55.971418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174c96-8713-41c7-b67d-4015f761059a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:55.971702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174c96-8713-41c7-b67d-4015f761059a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:55.971979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174c96-8713-41c7-b67d-4015f761059a None admin] PATH_INFO: `/v3/users/4b6eb9e833064d3d8e0744bf62655167` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:55.973671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22174c96-8713-41c7-b67d-4015f761059a None admin] RBAC: Authorizing `identity:get_user(user_id=4b6eb9e833064d3d8e0744bf62655167)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:55.975112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22174c96-8713-41c7-b67d-4015f761059a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:55.976694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 574/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:12:55 2022] GET /identity/v3/users/4b6eb9e833064d3d8e0744bf62655167 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:55.982342 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4817b9c-af18-4aff-a34f-bf81a705840b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:56.073706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4817b9c-af18-4aff-a34f-bf81a705840b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:56.104822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499fb7a-6503-41df-aee3-0bfdd5179914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:56.105646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499fb7a-6503-41df-aee3-0bfdd5179914 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:56.105928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499fb7a-6503-41df-aee3-0bfdd5179914 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:56.106228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499fb7a-6503-41df-aee3-0bfdd5179914 None admin] PATH_INFO: `/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:56.107378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499fb7a-6503-41df-aee3-0bfdd5179914 None admin] RBAC: Authorizing `identity:get_project(project_id=2ac0f7c2da91487ea25d2e06d24cb1f1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:56.108779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499fb7a-6503-41df-aee3-0bfdd5179914 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:56.110419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 548/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:12:55 2022] GET /identity/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:56.116699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174c96-8713-41c7-b67d-4015f761059a None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:56.208096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174c96-8713-41c7-b67d-4015f761059a None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:56.239631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287863b-facc-4bef-8110-d7b4d0ebb035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:56.240494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287863b-facc-4bef-8110-d7b4d0ebb035 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:56.240778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287863b-facc-4bef-8110-d7b4d0ebb035 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:56.241053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287863b-facc-4bef-8110-d7b4d0ebb035 None admin] PATH_INFO: `/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1/users/4b6eb9e833064d3d8e0744bf62655167/roles/59b67f94d2af48b08b7bef41a8396bfb` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:56.243234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287863b-facc-4bef-8110-d7b4d0ebb035 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ac0f7c2da91487ea25d2e06d24cb1f1, user_id=4b6eb9e833064d3d8e0744bf62655167, role_id=59b67f94d2af48b08b7bef41a8396bfb)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:56.244630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287863b-facc-4bef-8110-d7b4d0ebb035 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:56.256515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 575/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:12:56 2022] PUT /identity/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1/users/4b6eb9e833064d3d8e0744bf62655167/roles/59b67f94d2af48b08b7bef41a8396bfb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:12:58.543839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287253-068a-40c4-a4ee-c0a356d08bdb None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:58.544345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287253-068a-40c4-a4ee-c0a356d08bdb None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:58.544430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287253-068a-40c4-a4ee-c0a356d08bdb None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:58.546457 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 549/1124] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:12:58.552086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5effc2-7f93-43ea-91f7-b1f8abb5111d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:58.552493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5effc2-7f93-43ea-91f7-b1f8abb5111d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:58.552650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5effc2-7f93-43ea-91f7-b1f8abb5111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:58.568875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ed5effc2-7f93-43ea-91f7-b1f8abb5111d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:12:58.569985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ed5effc2-7f93-43ea-91f7-b1f8abb5111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:12:58.632659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 576/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:12:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:12:58.657002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f287253-068a-40c4-a4ee-c0a356d08bdb None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:58.750560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f287253-068a-40c4-a4ee-c0a356d08bdb None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:58.781675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81880441-9e1f-4291-bbe5-1b327e684054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:58.782543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81880441-9e1f-4291-bbe5-1b327e684054 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:58.782827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81880441-9e1f-4291-bbe5-1b327e684054 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:58.783103 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81880441-9e1f-4291-bbe5-1b327e684054 None admin] PATH_INFO: `/v3/roles/59b67f94d2af48b08b7bef41a8396bfb` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:58.785090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81880441-9e1f-4291-bbe5-1b327e684054 None admin] RBAC: Authorizing `identity:get_role(role_id=59b67f94d2af48b08b7bef41a8396bfb)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:58.786472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81880441-9e1f-4291-bbe5-1b327e684054 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:58.787792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 550/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:12:58 2022] GET /identity/v3/roles/59b67f94d2af48b08b7bef41a8396bfb => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:58.793438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5effc2-7f93-43ea-91f7-b1f8abb5111d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:58.888983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5effc2-7f93-43ea-91f7-b1f8abb5111d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:58.922054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528221-adbb-483d-8113-dfda514fce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:58.922952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528221-adbb-483d-8113-dfda514fce44 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:58.923240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528221-adbb-483d-8113-dfda514fce44 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:58.923517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528221-adbb-483d-8113-dfda514fce44 None admin] PATH_INFO: `/v3/users/4b6eb9e833064d3d8e0744bf62655167` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:58.924689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3528221-adbb-483d-8113-dfda514fce44 None admin] RBAC: Authorizing `identity:get_user(user_id=4b6eb9e833064d3d8e0744bf62655167)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:58.927075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3528221-adbb-483d-8113-dfda514fce44 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:58.928679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 577/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:12:58 2022] GET /identity/v3/users/4b6eb9e833064d3d8e0744bf62655167 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:12:58.934459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81880441-9e1f-4291-bbe5-1b327e684054 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:59.033004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81880441-9e1f-4291-bbe5-1b327e684054 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:59.064192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505ea09-8775-4817-847d-b2fd7ad9ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:59.064832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ea09-8775-4817-847d-b2fd7ad9ce16 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:59.065119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ea09-8775-4817-847d-b2fd7ad9ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:59.065399 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ea09-8775-4817-847d-b2fd7ad9ce16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:59.127281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505ea09-8775-4817-847d-b2fd7ad9ce16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:59.129234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505ea09-8775-4817-847d-b2fd7ad9ce16 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:59.220239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 551/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:12:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:12:59.226312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528221-adbb-483d-8113-dfda514fce44 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:59.317564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528221-adbb-483d-8113-dfda514fce44 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:59.469691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd884c-1cb9-42b2-b911-07d343014dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:59.470597 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd884c-1cb9-42b2-b911-07d343014dec None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:59.470825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd884c-1cb9-42b2-b911-07d343014dec None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:59.471095 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd884c-1cb9-42b2-b911-07d343014dec None admin] PATH_INFO: `/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:59.472251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd884c-1cb9-42b2-b911-07d343014dec None admin] RBAC: Authorizing `identity:get_project(project_id=2ac0f7c2da91487ea25d2e06d24cb1f1)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:59.473629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd884c-1cb9-42b2-b911-07d343014dec None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:59.475302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 578/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:12:59 2022] GET /identity/v3/projects/2ac0f7c2da91487ea25d2e06d24cb1f1 => generated 311 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:12:59.481406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505ea09-8775-4817-847d-b2fd7ad9ce16 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:12:59.574251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505ea09-8775-4817-847d-b2fd7ad9ce16 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:12:59.608177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a924dc5-3115-4f12-b7b2-aa0bed06ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:12:59.608816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a924dc5-3115-4f12-b7b2-aa0bed06ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:12:59.609097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a924dc5-3115-4f12-b7b2-aa0bed06ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:12:59.609367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a924dc5-3115-4f12-b7b2-aa0bed06ffd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:12:59.610208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a924dc5-3115-4f12-b7b2-aa0bed06ffd6 None admin] RBAC: Adding query filter params (role.id=59b67f94d2af48b08b7bef41a8396bfb, scope.project.id=2ac0f7c2da91487ea25d2e06d24cb1f1, user.id=4b6eb9e833064d3d8e0744bf62655167) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:12:59.610516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a924dc5-3115-4f12-b7b2-aa0bed06ffd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:12:59.612246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a924dc5-3115-4f12-b7b2-aa0bed06ffd6 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:12:59.618270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 552/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:12:59 2022] GET /identity/v3/role_assignments?user.id=4b6eb9e833064d3d8e0744bf62655167&scope.project.id=2ac0f7c2da91487ea25d2e06d24cb1f1&role.id=59b67f94d2af48b08b7bef41a8396bfb => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:01.884906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedac04-bc5b-4792-be6d-462e72143d4b None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:01.885427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedac04-bc5b-4792-be6d-462e72143d4b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:01.885427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedac04-bc5b-4792-be6d-462e72143d4b None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:01.887309 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 579/1131] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:01.892276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a9c1-21fe-4e30-90af-a9a13792531a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:01.892670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a9c1-21fe-4e30-90af-a9a13792531a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:01.892830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a9c1-21fe-4e30-90af-a9a13792531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:01.908867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bce7a9c1-21fe-4e30-90af-a9a13792531a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:01.910062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bce7a9c1-21fe-4e30-90af-a9a13792531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:01.970961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 553/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:01.994495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedac04-bc5b-4792-be6d-462e72143d4b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:02.090204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedac04-bc5b-4792-be6d-462e72143d4b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:02.121676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c3095-6e75-4ab3-89a6-f660600e4cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:02.122477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c3095-6e75-4ab3-89a6-f660600e4cda None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:02.122764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c3095-6e75-4ab3-89a6-f660600e4cda None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:02.123035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c3095-6e75-4ab3-89a6-f660600e4cda None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:02.124179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c3095-6e75-4ab3-89a6-f660600e4cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:02.125581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c3095-6e75-4ab3-89a6-f660600e4cda None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:02.127165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 580/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:02.132843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a9c1-21fe-4e30-90af-a9a13792531a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:02.223668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a9c1-21fe-4e30-90af-a9a13792531a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:02.254718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4089-1044-4a49-8e45-0c14ba5970f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:02.255354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4089-1044-4a49-8e45-0c14ba5970f4 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:02.255633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4089-1044-4a49-8e45-0c14ba5970f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:02.255907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4089-1044-4a49-8e45-0c14ba5970f4 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:02.256591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4089-1044-4a49-8e45-0c14ba5970f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:02.257991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4089-1044-4a49-8e45-0c14ba5970f4 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:02.281047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 554/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:13:02 2022] POST /identity/v3/projects => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:13:04.602659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0adaf-d741-409b-a05a-7f45cd4fd84f None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:04.603155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0adaf-d741-409b-a05a-7f45cd4fd84f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:04.603155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0adaf-d741-409b-a05a-7f45cd4fd84f None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:04.604874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 581/1135] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:04.609848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2319b-3e46-4583-a52b-02dd34d48646 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:04.610238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2319b-3e46-4583-a52b-02dd34d48646 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:04.610437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2319b-3e46-4583-a52b-02dd34d48646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:04.627140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-fad2319b-3e46-4583-a52b-02dd34d48646 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:04.628318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fad2319b-3e46-4583-a52b-02dd34d48646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:04.690177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 555/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:04.714435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0adaf-d741-409b-a05a-7f45cd4fd84f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:04.808895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0adaf-d741-409b-a05a-7f45cd4fd84f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:04.839920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcf6d1-3de9-498a-9db7-d0ed76863176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:04.840690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf6d1-3de9-498a-9db7-d0ed76863176 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:04.840971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf6d1-3de9-498a-9db7-d0ed76863176 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:04.841244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf6d1-3de9-498a-9db7-d0ed76863176 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:04.842421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcf6d1-3de9-498a-9db7-d0ed76863176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:04.843827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcf6d1-3de9-498a-9db7-d0ed76863176 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:04.845363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 582/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:13:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:04.851249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2319b-3e46-4583-a52b-02dd34d48646 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:04.942472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2319b-3e46-4583-a52b-02dd34d48646 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:04.973650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e98a6-743d-4cfe-9e48-a007f8b38ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:04.974568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e98a6-743d-4cfe-9e48-a007f8b38ae2 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:04.974847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e98a6-743d-4cfe-9e48-a007f8b38ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:04.975119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e98a6-743d-4cfe-9e48-a007f8b38ae2 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:04.975816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e98a6-743d-4cfe-9e48-a007f8b38ae2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:04.977217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e98a6-743d-4cfe-9e48-a007f8b38ae2 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:04.995771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 556/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:13:04 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:13:07.294858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa7a45-07e8-491d-9005-bc8989ad34e5 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:07.295658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa7a45-07e8-491d-9005-bc8989ad34e5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:07.295658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa7a45-07e8-491d-9005-bc8989ad34e5 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:07.297471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 583/1139] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:07.304045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02485992-b613-4119-9ec0-e99702c50587 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:07.304563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02485992-b613-4119-9ec0-e99702c50587 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:07.304651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02485992-b613-4119-9ec0-e99702c50587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:07.321547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-02485992-b613-4119-9ec0-e99702c50587 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:07.322757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-02485992-b613-4119-9ec0-e99702c50587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:07.387319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 557/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:07.411351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa7a45-07e8-491d-9005-bc8989ad34e5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:07.508724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa7a45-07e8-491d-9005-bc8989ad34e5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:07.540295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef4a4d-2b93-4704-b9d4-36bb11712ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:07.541067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef4a4d-2b93-4704-b9d4-36bb11712ab8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:07.541346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef4a4d-2b93-4704-b9d4-36bb11712ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:07.541614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef4a4d-2b93-4704-b9d4-36bb11712ab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:07.551324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef4a4d-2b93-4704-b9d4-36bb11712ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:13:07.557945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-3bef4a4d-2b93-4704-b9d4-36bb11712ab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:13:07.559106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 584/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:13:07.565091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02485992-b613-4119-9ec0-e99702c50587 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:07.666240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02485992-b613-4119-9ec0-e99702c50587 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:07.698458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905c459-b933-4be5-a0d6-837ca1d3bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:07.699111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905c459-b933-4be5-a0d6-837ca1d3bd1d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:07.699397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905c459-b933-4be5-a0d6-837ca1d3bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:07.699677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905c459-b933-4be5-a0d6-837ca1d3bd1d None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:07.700417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905c459-b933-4be5-a0d6-837ca1d3bd1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:07.700726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905c459-b933-4be5-a0d6-837ca1d3bd1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:07.702125 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905c459-b933-4be5-a0d6-837ca1d3bd1d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:07.709901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 558/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:13:07.715494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef4a4d-2b93-4704-b9d4-36bb11712ab8 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:07.807318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef4a4d-2b93-4704-b9d4-36bb11712ab8 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:07.839679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe37c-eb37-4727-9f66-41879474258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:07.840531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe37c-eb37-4727-9f66-41879474258b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:07.840814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe37c-eb37-4727-9f66-41879474258b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:07.841089 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe37c-eb37-4727-9f66-41879474258b None admin] PATH_INFO: `/v3/users/625eafb1a83a4293a4127e691e6afd93` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:07.853405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abe37c-eb37-4727-9f66-41879474258b None admin] RBAC: Authorizing `identity:get_user(user_id=625eafb1a83a4293a4127e691e6afd93)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:07.854868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abe37c-eb37-4727-9f66-41879474258b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:07.856449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 585/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:13:07 2022] GET /identity/v3/users/625eafb1a83a4293a4127e691e6afd93 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:07.862021 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905c459-b933-4be5-a0d6-837ca1d3bd1d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:07.955992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905c459-b933-4be5-a0d6-837ca1d3bd1d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:07.987086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2beb34-df75-48ac-850e-bd909325b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:07.987716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2beb34-df75-48ac-850e-bd909325b155 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:07.988000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2beb34-df75-48ac-850e-bd909325b155 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:07.988276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2beb34-df75-48ac-850e-bd909325b155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:08.050407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2beb34-df75-48ac-850e-bd909325b155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:08.052377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2beb34-df75-48ac-850e-bd909325b155 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:08.142961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 559/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:13:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:13:08.148583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe37c-eb37-4727-9f66-41879474258b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:08.239564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe37c-eb37-4727-9f66-41879474258b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:08.269834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14165e68-92a5-4e9a-923d-77cfe581fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:08.270689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14165e68-92a5-4e9a-923d-77cfe581fb93 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:08.270969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14165e68-92a5-4e9a-923d-77cfe581fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:08.271241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14165e68-92a5-4e9a-923d-77cfe581fb93 None admin] PATH_INFO: `/v3/projects/01c06ebe09c14253bb47f76c5e71cc1c` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:08.272380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14165e68-92a5-4e9a-923d-77cfe581fb93 None admin] RBAC: Authorizing `identity:get_project(project_id=01c06ebe09c14253bb47f76c5e71cc1c)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:08.273779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14165e68-92a5-4e9a-923d-77cfe581fb93 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:08.275436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 586/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:13:08 2022] GET /identity/v3/projects/01c06ebe09c14253bb47f76c5e71cc1c => generated 311 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:08.281200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2beb34-df75-48ac-850e-bd909325b155 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:08.380766 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2beb34-df75-48ac-850e-bd909325b155 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:08.412688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956a859-a372-4e53-9eb0-7b9bde6706ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:08.413270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956a859-a372-4e53-9eb0-7b9bde6706ef None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:08.413551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956a859-a372-4e53-9eb0-7b9bde6706ef None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:08.413827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956a859-a372-4e53-9eb0-7b9bde6706ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:08.414674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956a859-a372-4e53-9eb0-7b9bde6706ef None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=01c06ebe09c14253bb47f76c5e71cc1c, user.id=625eafb1a83a4293a4127e691e6afd93) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:08.414980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956a859-a372-4e53-9eb0-7b9bde6706ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:08.416406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956a859-a372-4e53-9eb0-7b9bde6706ef None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:08.421755 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 560/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:13:08 2022] GET /identity/v3/role_assignments?user.id=625eafb1a83a4293a4127e691e6afd93&scope.project.id=01c06ebe09c14253bb47f76c5e71cc1c&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:10.662583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a6c0-1688-475d-9a4d-0a9d8fbdbbe9 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:10.663079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a6c0-1688-475d-9a4d-0a9d8fbdbbe9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:10.663079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a6c0-1688-475d-9a4d-0a9d8fbdbbe9 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:10.664831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 587/1147] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:13:10.670313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd52a76-5f09-4f35-a878-c6a63deaa501 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:10.670756 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd52a76-5f09-4f35-a878-c6a63deaa501 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:10.670882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd52a76-5f09-4f35-a878-c6a63deaa501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:10.687304 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-dcd52a76-5f09-4f35-a878-c6a63deaa501 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:10.688475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-dcd52a76-5f09-4f35-a878-c6a63deaa501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:10.750791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 561/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:10.773374 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a6c0-1688-475d-9a4d-0a9d8fbdbbe9 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:10.867097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a6c0-1688-475d-9a4d-0a9d8fbdbbe9 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:10.898243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56122261-2815-4d21-a2e3-a8fc56d3daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:10.899012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122261-2815-4d21-a2e3-a8fc56d3daad None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:10.899296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122261-2815-4d21-a2e3-a8fc56d3daad None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:10.899569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122261-2815-4d21-a2e3-a8fc56d3daad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:10.909030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56122261-2815-4d21-a2e3-a8fc56d3daad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:13:10.916310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-56122261-2815-4d21-a2e3-a8fc56d3daad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:13:10.917376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 588/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:13:10.923425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd52a76-5f09-4f35-a878-c6a63deaa501 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:11.015830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd52a76-5f09-4f35-a878-c6a63deaa501 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:11.047627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d457c-f275-47ee-aa35-4e09d44ee1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:11.048273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d457c-f275-47ee-aa35-4e09d44ee1d3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:11.048558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d457c-f275-47ee-aa35-4e09d44ee1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:11.048836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d457c-f275-47ee-aa35-4e09d44ee1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:11.049573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d457c-f275-47ee-aa35-4e09d44ee1d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:11.049878 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d457c-f275-47ee-aa35-4e09d44ee1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:11.051324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d457c-f275-47ee-aa35-4e09d44ee1d3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:11.058884 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 562/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:11.064269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56122261-2815-4d21-a2e3-a8fc56d3daad None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:11.155639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56122261-2815-4d21-a2e3-a8fc56d3daad None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:11.186013 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974ab22-726e-4a3b-b9a4-76f5ced14f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:11.186839 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974ab22-726e-4a3b-b9a4-76f5ced14f0b None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:11.187121 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974ab22-726e-4a3b-b9a4-76f5ced14f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:11.187392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974ab22-726e-4a3b-b9a4-76f5ced14f0b None admin] PATH_INFO: `/v3/users/625eafb1a83a4293a4127e691e6afd93` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:11.188544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974ab22-726e-4a3b-b9a4-76f5ced14f0b None admin] RBAC: Authorizing `identity:get_user(user_id=625eafb1a83a4293a4127e691e6afd93)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:11.189941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974ab22-726e-4a3b-b9a4-76f5ced14f0b None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:11.192066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 589/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:13:11 2022] GET /identity/v3/users/625eafb1a83a4293a4127e691e6afd93 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:11.197740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d457c-f275-47ee-aa35-4e09d44ee1d3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:11.291810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d457c-f275-47ee-aa35-4e09d44ee1d3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:11.324269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84657989-a9a4-4250-a65e-a14d6ae3bd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:11.325122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84657989-a9a4-4250-a65e-a14d6ae3bd37 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:11.325409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84657989-a9a4-4250-a65e-a14d6ae3bd37 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:11.325688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84657989-a9a4-4250-a65e-a14d6ae3bd37 None admin] PATH_INFO: `/v3/projects/01c06ebe09c14253bb47f76c5e71cc1c` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:11.326895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84657989-a9a4-4250-a65e-a14d6ae3bd37 None admin] RBAC: Authorizing `identity:get_project(project_id=01c06ebe09c14253bb47f76c5e71cc1c)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:11.328327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84657989-a9a4-4250-a65e-a14d6ae3bd37 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:11.329998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 563/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:13:11 2022] GET /identity/v3/projects/01c06ebe09c14253bb47f76c5e71cc1c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:11.336408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974ab22-726e-4a3b-b9a4-76f5ced14f0b None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:11.427960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974ab22-726e-4a3b-b9a4-76f5ced14f0b None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:11.458517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea675f-e517-42cd-b534-e8c67b306397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:11.459322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea675f-e517-42cd-b534-e8c67b306397 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:11.459603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea675f-e517-42cd-b534-e8c67b306397 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:11.459876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea675f-e517-42cd-b534-e8c67b306397 None admin] PATH_INFO: `/v3/projects/01c06ebe09c14253bb47f76c5e71cc1c/users/625eafb1a83a4293a4127e691e6afd93/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:11.461779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea675f-e517-42cd-b534-e8c67b306397 None admin] RBAC: Authorizing `identity:create_grant(project_id=01c06ebe09c14253bb47f76c5e71cc1c, user_id=625eafb1a83a4293a4127e691e6afd93, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:11.463213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea675f-e517-42cd-b534-e8c67b306397 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:11.475814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 590/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:13:11 2022] PUT /identity/v3/projects/01c06ebe09c14253bb47f76c5e71cc1c/users/625eafb1a83a4293a4127e691e6afd93/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:13:13.705054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea92bab-4ad7-4cfc-9a06-abc3c6be74e6 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:13.705639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea92bab-4ad7-4cfc-9a06-abc3c6be74e6 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:13.705639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea92bab-4ad7-4cfc-9a06-abc3c6be74e6 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:13.707890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 564/1154] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:13.712937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01904c6-2a52-4f9d-89d3-e0e722b05a23 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:13.713375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01904c6-2a52-4f9d-89d3-e0e722b05a23 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:13.713485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01904c6-2a52-4f9d-89d3-e0e722b05a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:13.730837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e01904c6-2a52-4f9d-89d3-e0e722b05a23 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:13.732000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e01904c6-2a52-4f9d-89d3-e0e722b05a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:13.793532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 591/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:13.816597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea92bab-4ad7-4cfc-9a06-abc3c6be74e6 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:13.911585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea92bab-4ad7-4cfc-9a06-abc3c6be74e6 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:13.943208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc1f2b-85bf-4503-918e-b331a6061cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:13.943977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc1f2b-85bf-4503-918e-b331a6061cc1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:13.944260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc1f2b-85bf-4503-918e-b331a6061cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:13.944534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc1f2b-85bf-4503-918e-b331a6061cc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:13.954087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc1f2b-85bf-4503-918e-b331a6061cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:13:13.961613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-76cc1f2b-85bf-4503-918e-b331a6061cc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:13:13.962730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 565/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:13:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:13:13.968498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01904c6-2a52-4f9d-89d3-e0e722b05a23 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:14.063525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01904c6-2a52-4f9d-89d3-e0e722b05a23 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:14.095266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761f10-ef25-43be-817a-bbd7e76bbbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:14.095923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761f10-ef25-43be-817a-bbd7e76bbbfd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:14.096204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761f10-ef25-43be-817a-bbd7e76bbbfd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:14.096476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761f10-ef25-43be-817a-bbd7e76bbbfd None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:14.097200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761f10-ef25-43be-817a-bbd7e76bbbfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:14.097503 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761f10-ef25-43be-817a-bbd7e76bbbfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:14.098900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761f10-ef25-43be-817a-bbd7e76bbbfd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:14.106409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 592/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:13:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:14.112259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc1f2b-85bf-4503-918e-b331a6061cc1 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:14.206001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc1f2b-85bf-4503-918e-b331a6061cc1 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:14.237391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2211fe-bbef-48c5-bee8-2ef76e963385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:14.238325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2211fe-bbef-48c5-bee8-2ef76e963385 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:14.238611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2211fe-bbef-48c5-bee8-2ef76e963385 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:14.238886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2211fe-bbef-48c5-bee8-2ef76e963385 None admin] PATH_INFO: `/v3/users/625eafb1a83a4293a4127e691e6afd93` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:14.240060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2211fe-bbef-48c5-bee8-2ef76e963385 None admin] RBAC: Authorizing `identity:get_user(user_id=625eafb1a83a4293a4127e691e6afd93)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:14.241476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2211fe-bbef-48c5-bee8-2ef76e963385 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:14.243102 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 566/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:13:14 2022] GET /identity/v3/users/625eafb1a83a4293a4127e691e6afd93 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:14.248898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761f10-ef25-43be-817a-bbd7e76bbbfd None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:14.343484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761f10-ef25-43be-817a-bbd7e76bbbfd None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:14.375287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4c877-49cb-4a3c-a7ef-73f171317876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:14.375929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4c877-49cb-4a3c-a7ef-73f171317876 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:14.376212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4c877-49cb-4a3c-a7ef-73f171317876 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:14.376514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4c877-49cb-4a3c-a7ef-73f171317876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:14.438245 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4c877-49cb-4a3c-a7ef-73f171317876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:14.439667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4c877-49cb-4a3c-a7ef-73f171317876 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:14.529814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 593/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:13:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:13:14.535703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2211fe-bbef-48c5-bee8-2ef76e963385 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:14.628240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2211fe-bbef-48c5-bee8-2ef76e963385 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:14.659195 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c80048-a4e4-44a1-9af8-5643c42131b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:14.660054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80048-a4e4-44a1-9af8-5643c42131b3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:14.660347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80048-a4e4-44a1-9af8-5643c42131b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:14.660625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80048-a4e4-44a1-9af8-5643c42131b3 None admin] PATH_INFO: `/v3/projects/01c06ebe09c14253bb47f76c5e71cc1c` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:14.661778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c80048-a4e4-44a1-9af8-5643c42131b3 None admin] RBAC: Authorizing `identity:get_project(project_id=01c06ebe09c14253bb47f76c5e71cc1c)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:14.663224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c80048-a4e4-44a1-9af8-5643c42131b3 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:14.664867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 567/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:13:14 2022] GET /identity/v3/projects/01c06ebe09c14253bb47f76c5e71cc1c => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:14.670994 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4c877-49cb-4a3c-a7ef-73f171317876 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:14.763427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4c877-49cb-4a3c-a7ef-73f171317876 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:14.794677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff7310-533b-4e08-b784-cf9b332d299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:14.795521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff7310-533b-4e08-b784-cf9b332d299f None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:14.795807 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff7310-533b-4e08-b784-cf9b332d299f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:14.796083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff7310-533b-4e08-b784-cf9b332d299f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:14.796893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff7310-533b-4e08-b784-cf9b332d299f None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=01c06ebe09c14253bb47f76c5e71cc1c, user.id=625eafb1a83a4293a4127e691e6afd93) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:14.797203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff7310-533b-4e08-b784-cf9b332d299f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:14.798634 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff7310-533b-4e08-b784-cf9b332d299f None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:14.804657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 594/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:13:14 2022] GET /identity/v3/role_assignments?user.id=625eafb1a83a4293a4127e691e6afd93&scope.project.id=01c06ebe09c14253bb47f76c5e71cc1c&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:13:17.095662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f675a-a296-4368-b0f4-1e53fe4db93f None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:17.096216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f675a-a296-4368-b0f4-1e53fe4db93f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:17.096216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f675a-a296-4368-b0f4-1e53fe4db93f None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:17.098550 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 568/1162] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:17.103705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0351f43-0ad6-4edd-820c-e44d4806e38f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:17.104091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0351f43-0ad6-4edd-820c-e44d4806e38f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:17.104413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0351f43-0ad6-4edd-820c-e44d4806e38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:17.121274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e0351f43-0ad6-4edd-820c-e44d4806e38f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:17.122456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e0351f43-0ad6-4edd-820c-e44d4806e38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:17.184433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 595/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:17.206081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f675a-a296-4368-b0f4-1e53fe4db93f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:17.303128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f675a-a296-4368-b0f4-1e53fe4db93f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:17.334404 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7240dd-77b0-4c2c-bf0a-6b2d5795c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:17.335047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7240dd-77b0-4c2c-bf0a-6b2d5795c80c None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:17.335335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7240dd-77b0-4c2c-bf0a-6b2d5795c80c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:17.335615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7240dd-77b0-4c2c-bf0a-6b2d5795c80c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:17.397626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7240dd-77b0-4c2c-bf0a-6b2d5795c80c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:17.399035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7240dd-77b0-4c2c-bf0a-6b2d5795c80c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:17.489768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 569/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:13:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:13:17.495724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0351f43-0ad6-4edd-820c-e44d4806e38f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:17.586478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0351f43-0ad6-4edd-820c-e44d4806e38f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:17.617630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3cba1-136a-425b-b0ac-1341fff147fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:17.618436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3cba1-136a-425b-b0ac-1341fff147fd None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:17.618717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3cba1-136a-425b-b0ac-1341fff147fd None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:17.618988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3cba1-136a-425b-b0ac-1341fff147fd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:17.625242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3cba1-136a-425b-b0ac-1341fff147fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:17.626676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3cba1-136a-425b-b0ac-1341fff147fd None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:17.639769 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-76c3cba1-136a-425b-b0ac-1341fff147fd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 10 17:13:17.640870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 596/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:13:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:13:17.647162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7240dd-77b0-4c2c-bf0a-6b2d5795c80c None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:17.752519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7240dd-77b0-4c2c-bf0a-6b2d5795c80c None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:17.784491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc1d5f-8935-48ec-96dd-0b1723ddda2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:17.785171 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc1d5f-8935-48ec-96dd-0b1723ddda2b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:17.785455 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc1d5f-8935-48ec-96dd-0b1723ddda2b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:17.785730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc1d5f-8935-48ec-96dd-0b1723ddda2b None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:17.786482 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc1d5f-8935-48ec-96dd-0b1723ddda2b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:17.786787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc1d5f-8935-48ec-96dd-0b1723ddda2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:17.788146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc1d5f-8935-48ec-96dd-0b1723ddda2b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:17.795188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 570/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Mar 10 17:13:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:20.074916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205486-9c98-44af-91d0-94863eb06fa8 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:20.075464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205486-9c98-44af-91d0-94863eb06fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:20.075464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205486-9c98-44af-91d0-94863eb06fa8 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:20.077208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 597/1167] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:20.082991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dd14d-0f21-43dd-a9b6-540f56cfa84d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:20.083439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dd14d-0f21-43dd-a9b6-540f56cfa84d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:20.083548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dd14d-0f21-43dd-a9b6-540f56cfa84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:20.099775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bc5dd14d-0f21-43dd-a9b6-540f56cfa84d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:20.100944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bc5dd14d-0f21-43dd-a9b6-540f56cfa84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:20.163359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 571/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:20.186437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32205486-9c98-44af-91d0-94863eb06fa8 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:20.280063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32205486-9c98-44af-91d0-94863eb06fa8 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:20.311493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73162817-e254-4e69-b1ab-07e49393f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:20.312146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73162817-e254-4e69-b1ab-07e49393f307 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:20.312423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73162817-e254-4e69-b1ab-07e49393f307 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:20.312694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73162817-e254-4e69-b1ab-07e49393f307 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:20.313420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73162817-e254-4e69-b1ab-07e49393f307 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:20.314792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73162817-e254-4e69-b1ab-07e49393f307 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:20.329358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 598/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Thu Mar 10 17:13:20 2022] POST /identity/v3/domains => generated 267 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:13:22.611364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ab9a-7b4c-4abb-913b-2909b9a02cfb None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:22.611874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ab9a-7b4c-4abb-913b-2909b9a02cfb None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:22.611874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ab9a-7b4c-4abb-913b-2909b9a02cfb None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:22.613620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 572/1170] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:22.618693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2bfc-9486-402c-be1a-d8ed8545b7b4 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:22.619070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2bfc-9486-402c-be1a-d8ed8545b7b4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:22.619250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2bfc-9486-402c-be1a-d8ed8545b7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:22.635403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-72bb2bfc-9486-402c-be1a-d8ed8545b7b4 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:22.636572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-72bb2bfc-9486-402c-be1a-d8ed8545b7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:22.699962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 599/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:22.724437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2ab9a-7b4c-4abb-913b-2909b9a02cfb None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:22.817810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2ab9a-7b4c-4abb-913b-2909b9a02cfb None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:22.849955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743f319-4ae9-4f8e-a3eb-2a08dbe50653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:22.850838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743f319-4ae9-4f8e-a3eb-2a08dbe50653 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:22.851131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743f319-4ae9-4f8e-a3eb-2a08dbe50653 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:22.851410 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743f319-4ae9-4f8e-a3eb-2a08dbe50653 None admin] PATH_INFO: `/v3/domains/1231a553c6cc4c538740e059a1990d08` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:22.861241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743f319-4ae9-4f8e-a3eb-2a08dbe50653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1231a553c6cc4c538740e059a1990d08)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:22.862769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743f319-4ae9-4f8e-a3eb-2a08dbe50653 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:22.864347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 573/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Mar 10 17:13:22 2022] GET /identity/v3/domains/1231a553c6cc4c538740e059a1990d08 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:22.870031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb2bfc-9486-402c-be1a-d8ed8545b7b4 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:22.961715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb2bfc-9486-402c-be1a-d8ed8545b7b4 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:22.992191 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df32c7-5d51-4601-95b9-110685d1f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:22.992847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df32c7-5d51-4601-95b9-110685d1f24e None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:22.993129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df32c7-5d51-4601-95b9-110685d1f24e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:22.993402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df32c7-5d51-4601-95b9-110685d1f24e None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:22.994096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df32c7-5d51-4601-95b9-110685d1f24e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:22.995534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df32c7-5d51-4601-95b9-110685d1f24e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:23.019866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 600/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:13:22 2022] POST /identity/v3/projects => generated 361 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:13:25.302323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e079-e863-4ce9-b9bc-dad0f5c512c3 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:25.302844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e079-e863-4ce9-b9bc-dad0f5c512c3 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:25.302933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e079-e863-4ce9-b9bc-dad0f5c512c3 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:25.304652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 574/1174] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:25.309948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2c572-63da-4058-90fb-7008240d6078 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:25.310350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2c572-63da-4058-90fb-7008240d6078 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:25.310542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2c572-63da-4058-90fb-7008240d6078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:25.326770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c3e2c572-63da-4058-90fb-7008240d6078 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:25.327943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c3e2c572-63da-4058-90fb-7008240d6078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:25.391705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 601/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:25.417500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e079-e863-4ce9-b9bc-dad0f5c512c3 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:25.512298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e079-e863-4ce9-b9bc-dad0f5c512c3 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:25.544107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303203c-af57-484f-b06d-13ef18f1c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:25.545217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303203c-af57-484f-b06d-13ef18f1c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:25.545496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303203c-af57-484f-b06d-13ef18f1c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:25.545795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303203c-af57-484f-b06d-13ef18f1c3e5 None admin] PATH_INFO: `/v3/domains/1231a553c6cc4c538740e059a1990d08` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:25.546980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303203c-af57-484f-b06d-13ef18f1c3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1231a553c6cc4c538740e059a1990d08)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:25.548394 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303203c-af57-484f-b06d-13ef18f1c3e5 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:25.549948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 575/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Mar 10 17:13:25 2022] GET /identity/v3/domains/1231a553c6cc4c538740e059a1990d08 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:25.556160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2c572-63da-4058-90fb-7008240d6078 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:25.646457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2c572-63da-4058-90fb-7008240d6078 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:25.680853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9a98-24b2-4954-ad60-f479117989d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:25.681621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9a98-24b2-4954-ad60-f479117989d5 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:25.681898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9a98-24b2-4954-ad60-f479117989d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:25.682199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9a98-24b2-4954-ad60-f479117989d5 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:25.682922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9a98-24b2-4954-ad60-f479117989d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:25.684338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9a98-24b2-4954-ad60-f479117989d5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:25.703316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 602/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:13:25 2022] POST /identity/v3/users => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:13:28.015398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc29042-4918-45a5-a0ef-694f04ab9a45 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:28.015951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc29042-4918-45a5-a0ef-694f04ab9a45 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:28.015951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc29042-4918-45a5-a0ef-694f04ab9a45 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:28.017704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 576/1178] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:28.023400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4f07-daa8-467b-b2d7-2ab3593123d3 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:28.023813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4f07-daa8-467b-b2d7-2ab3593123d3 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:28.023961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4f07-daa8-467b-b2d7-2ab3593123d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:28.040648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-babe4f07-daa8-467b-b2d7-2ab3593123d3 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:28.041823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-babe4f07-daa8-467b-b2d7-2ab3593123d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:28.103338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 603/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:28.135874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc29042-4918-45a5-a0ef-694f04ab9a45 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:28.229765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc29042-4918-45a5-a0ef-694f04ab9a45 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:28.260629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146772cd-57f3-464d-81a7-f63dfb2234e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:28.261394 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146772cd-57f3-464d-81a7-f63dfb2234e7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:28.261672 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146772cd-57f3-464d-81a7-f63dfb2234e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:28.261943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146772cd-57f3-464d-81a7-f63dfb2234e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:28.271977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146772cd-57f3-464d-81a7-f63dfb2234e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:13:28.278699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-146772cd-57f3-464d-81a7-f63dfb2234e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:13:28.279820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 577/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:13:28.285495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4f07-daa8-467b-b2d7-2ab3593123d3 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:28.377364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4f07-daa8-467b-b2d7-2ab3593123d3 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:28.409660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7419d8-2109-4f36-b7ec-d22c192be3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:28.410550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7419d8-2109-4f36-b7ec-d22c192be3aa None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:28.410842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7419d8-2109-4f36-b7ec-d22c192be3aa None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:28.411124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7419d8-2109-4f36-b7ec-d22c192be3aa None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:28.411873 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7419d8-2109-4f36-b7ec-d22c192be3aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:28.412183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7419d8-2109-4f36-b7ec-d22c192be3aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:28.413543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7419d8-2109-4f36-b7ec-d22c192be3aa None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:28.421695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 604/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:28.427350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146772cd-57f3-464d-81a7-f63dfb2234e7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:28.520533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146772cd-57f3-464d-81a7-f63dfb2234e7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:28.551468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c000f-1a5d-463b-8955-f41df04b5648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:28.552268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c000f-1a5d-463b-8955-f41df04b5648 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:28.552551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c000f-1a5d-463b-8955-f41df04b5648 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:28.552825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c000f-1a5d-463b-8955-f41df04b5648 None admin] PATH_INFO: `/v3/users/ffd9e99fc06f4618904324bc75374e5a` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:28.565144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c000f-1a5d-463b-8955-f41df04b5648 None admin] RBAC: Authorizing `identity:get_user(user_id=ffd9e99fc06f4618904324bc75374e5a)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:28.567090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c000f-1a5d-463b-8955-f41df04b5648 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:28.568662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 578/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:13:28 2022] GET /identity/v3/users/ffd9e99fc06f4618904324bc75374e5a => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:28.574015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7419d8-2109-4f36-b7ec-d22c192be3aa None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:28.665034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7419d8-2109-4f36-b7ec-d22c192be3aa None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:28.696589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055d737-3f68-44d6-95fa-9303be18ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:28.697216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055d737-3f68-44d6-95fa-9303be18ad14 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:28.697500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055d737-3f68-44d6-95fa-9303be18ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:28.697782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055d737-3f68-44d6-95fa-9303be18ad14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:28.768600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055d737-3f68-44d6-95fa-9303be18ad14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:28.770055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055d737-3f68-44d6-95fa-9303be18ad14 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:28.859564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 605/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:13:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:13:28.865831 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c000f-1a5d-463b-8955-f41df04b5648 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:28.957955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c000f-1a5d-463b-8955-f41df04b5648 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:28.989473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3656fdd-6cc7-4b7a-9714-0f42c956d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:28.990328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3656fdd-6cc7-4b7a-9714-0f42c956d69a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:28.990608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3656fdd-6cc7-4b7a-9714-0f42c956d69a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:28.990881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3656fdd-6cc7-4b7a-9714-0f42c956d69a None admin] PATH_INFO: `/v3/projects/91372cc51abb4ebc83f724fe2661ac5e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:28.992031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3656fdd-6cc7-4b7a-9714-0f42c956d69a None admin] RBAC: Authorizing `identity:get_project(project_id=91372cc51abb4ebc83f724fe2661ac5e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:28.993435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3656fdd-6cc7-4b7a-9714-0f42c956d69a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:28.995096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 579/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:13:28 2022] GET /identity/v3/projects/91372cc51abb4ebc83f724fe2661ac5e => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:29.000894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055d737-3f68-44d6-95fa-9303be18ad14 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:29.096648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055d737-3f68-44d6-95fa-9303be18ad14 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:29.129506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae72b7-2bf1-4145-b03f-52f66dabd3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:29.130089 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae72b7-2bf1-4145-b03f-52f66dabd3c2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:29.130402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae72b7-2bf1-4145-b03f-52f66dabd3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:29.130676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae72b7-2bf1-4145-b03f-52f66dabd3c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:29.131485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae72b7-2bf1-4145-b03f-52f66dabd3c2 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=91372cc51abb4ebc83f724fe2661ac5e, user.id=ffd9e99fc06f4618904324bc75374e5a) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:29.131791 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae72b7-2bf1-4145-b03f-52f66dabd3c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:29.133283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae72b7-2bf1-4145-b03f-52f66dabd3c2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:29.146621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 606/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:13:28 2022] GET /identity/v3/role_assignments?user.id=ffd9e99fc06f4618904324bc75374e5a&scope.project.id=91372cc51abb4ebc83f724fe2661ac5e&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:31.385662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046c93-92c6-42a0-acdf-03e968c18839 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:31.386157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046c93-92c6-42a0-acdf-03e968c18839 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:31.386269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046c93-92c6-42a0-acdf-03e968c18839 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:31.388029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 580/1186] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:31.393095 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f8018-818f-4de3-a731-8c75f27e2fc8 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:31.393515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f8018-818f-4de3-a731-8c75f27e2fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:31.393646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f8018-818f-4de3-a731-8c75f27e2fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:31.410393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-db2f8018-818f-4de3-a731-8c75f27e2fc8 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:31.411549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-db2f8018-818f-4de3-a731-8c75f27e2fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:31.474275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 607/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:31.497745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1046c93-92c6-42a0-acdf-03e968c18839 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:31.591669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1046c93-92c6-42a0-acdf-03e968c18839 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:31.623174 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a781-2f5a-41ea-88a9-f6450de7acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:31.623947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a781-2f5a-41ea-88a9-f6450de7acc3 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:31.624228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a781-2f5a-41ea-88a9-f6450de7acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:31.624502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a781-2f5a-41ea-88a9-f6450de7acc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:31.634018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7a781-2f5a-41ea-88a9-f6450de7acc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:13:31.640887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-d7c7a781-2f5a-41ea-88a9-f6450de7acc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:13:31.642023 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 581/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:13:31.648426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f8018-818f-4de3-a731-8c75f27e2fc8 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:31.740710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f8018-818f-4de3-a731-8c75f27e2fc8 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:31.777395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d9221-5804-4cff-9482-65a2566c44cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:31.778071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9221-5804-4cff-9482-65a2566c44cb None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:31.778385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9221-5804-4cff-9482-65a2566c44cb None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:31.778659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9221-5804-4cff-9482-65a2566c44cb None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:31.779398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d9221-5804-4cff-9482-65a2566c44cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:31.779700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d9221-5804-4cff-9482-65a2566c44cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:31.781052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d9221-5804-4cff-9482-65a2566c44cb None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:31.789834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 608/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:31.795960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a781-2f5a-41ea-88a9-f6450de7acc3 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:31.888327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a781-2f5a-41ea-88a9-f6450de7acc3 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:31.920013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa118-9209-4a3a-8247-229a5230e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:31.920883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa118-9209-4a3a-8247-229a5230e98e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:31.921167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa118-9209-4a3a-8247-229a5230e98e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:31.921443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa118-9209-4a3a-8247-229a5230e98e None admin] PATH_INFO: `/v3/users/ffd9e99fc06f4618904324bc75374e5a` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:31.922626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa118-9209-4a3a-8247-229a5230e98e None admin] RBAC: Authorizing `identity:get_user(user_id=ffd9e99fc06f4618904324bc75374e5a)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:31.924045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa118-9209-4a3a-8247-229a5230e98e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:31.925645 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 582/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:13:31 2022] GET /identity/v3/users/ffd9e99fc06f4618904324bc75374e5a => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:31.931166 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d9221-5804-4cff-9482-65a2566c44cb None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:32.023553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d9221-5804-4cff-9482-65a2566c44cb None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:32.054376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7ce5d-6c7b-4ffe-838a-3ae577cb62f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:32.055239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7ce5d-6c7b-4ffe-838a-3ae577cb62f6 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:32.055619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7ce5d-6c7b-4ffe-838a-3ae577cb62f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:32.056057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7ce5d-6c7b-4ffe-838a-3ae577cb62f6 None admin] PATH_INFO: `/v3/projects/91372cc51abb4ebc83f724fe2661ac5e` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:32.058000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7ce5d-6c7b-4ffe-838a-3ae577cb62f6 None admin] RBAC: Authorizing `identity:get_project(project_id=91372cc51abb4ebc83f724fe2661ac5e)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:32.059464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7ce5d-6c7b-4ffe-838a-3ae577cb62f6 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:32.061137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 609/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:13:31 2022] GET /identity/v3/projects/91372cc51abb4ebc83f724fe2661ac5e => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:32.067470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa118-9209-4a3a-8247-229a5230e98e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:32.160589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa118-9209-4a3a-8247-229a5230e98e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:32.191765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd58dce-5eea-44da-8d2e-731a44f1947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:32.192636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd58dce-5eea-44da-8d2e-731a44f1947c None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:32.192912 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd58dce-5eea-44da-8d2e-731a44f1947c None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:32.193184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd58dce-5eea-44da-8d2e-731a44f1947c None admin] PATH_INFO: `/v3/projects/91372cc51abb4ebc83f724fe2661ac5e/users/ffd9e99fc06f4618904324bc75374e5a/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:32.195143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd58dce-5eea-44da-8d2e-731a44f1947c None admin] RBAC: Authorizing `identity:create_grant(project_id=91372cc51abb4ebc83f724fe2661ac5e, user_id=ffd9e99fc06f4618904324bc75374e5a, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:32.196555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd58dce-5eea-44da-8d2e-731a44f1947c None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:32.209439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 583/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:13:32 2022] PUT /identity/v3/projects/91372cc51abb4ebc83f724fe2661ac5e/users/ffd9e99fc06f4618904324bc75374e5a/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:13:34.457676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2b81a-c608-4ef4-bc07-8b2cd153e665 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:34.458216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2b81a-c608-4ef4-bc07-8b2cd153e665 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:34.458326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2b81a-c608-4ef4-bc07-8b2cd153e665 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:34.460001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 610/1193] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:13:34.465029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54c7f8-ae03-4418-9a8c-7ffbebaeb385 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:34.465406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54c7f8-ae03-4418-9a8c-7ffbebaeb385 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:34.465578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54c7f8-ae03-4418-9a8c-7ffbebaeb385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:34.481769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3c54c7f8-ae03-4418-9a8c-7ffbebaeb385 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:13:34.482968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3c54c7f8-ae03-4418-9a8c-7ffbebaeb385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:13:34.546353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 584/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:13:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:13:34.569978 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2b81a-c608-4ef4-bc07-8b2cd153e665 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:34.663116 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2b81a-c608-4ef4-bc07-8b2cd153e665 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:34.694559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86800815-bc30-40e5-a917-f50e10a90a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:34.695327 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86800815-bc30-40e5-a917-f50e10a90a88 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:34.695608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86800815-bc30-40e5-a917-f50e10a90a88 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:34.695880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86800815-bc30-40e5-a917-f50e10a90a88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:34.705171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86800815-bc30-40e5-a917-f50e10a90a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:13:34.712021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-86800815-bc30-40e5-a917-f50e10a90a88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:13:34.713138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 611/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:13:34.718782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54c7f8-ae03-4418-9a8c-7ffbebaeb385 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:34.811268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54c7f8-ae03-4418-9a8c-7ffbebaeb385 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:34.843822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a478-44e2-459d-8cfd-f3696f1b5337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:34.844418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a478-44e2-459d-8cfd-f3696f1b5337 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:34.844701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a478-44e2-459d-8cfd-f3696f1b5337 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:34.844978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a478-44e2-459d-8cfd-f3696f1b5337 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:34.845714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a478-44e2-459d-8cfd-f3696f1b5337 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:34.846022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a478-44e2-459d-8cfd-f3696f1b5337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:34.847445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a478-44e2-459d-8cfd-f3696f1b5337 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:34.855057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 585/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:34.860604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86800815-bc30-40e5-a917-f50e10a90a88 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:34.952542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86800815-bc30-40e5-a917-f50e10a90a88 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:34.983069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c73a5-cb9a-4386-97ed-0f42719523e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:34.983913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c73a5-cb9a-4386-97ed-0f42719523e0 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:34.984190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c73a5-cb9a-4386-97ed-0f42719523e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:34.984460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c73a5-cb9a-4386-97ed-0f42719523e0 None admin] PATH_INFO: `/v3/users/ffd9e99fc06f4618904324bc75374e5a` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:34.985610 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c73a5-cb9a-4386-97ed-0f42719523e0 None admin] RBAC: Authorizing `identity:get_user(user_id=ffd9e99fc06f4618904324bc75374e5a)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:34.987049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c73a5-cb9a-4386-97ed-0f42719523e0 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:34.989151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 612/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Mar 10 17:13:34 2022] GET /identity/v3/users/ffd9e99fc06f4618904324bc75374e5a => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:34.994694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a478-44e2-459d-8cfd-f3696f1b5337 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:35.088420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a478-44e2-459d-8cfd-f3696f1b5337 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:35.118966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f9089-574c-4e6c-9207-709e5ab8cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:35.119548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9089-574c-4e6c-9207-709e5ab8cb5e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:35.119833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9089-574c-4e6c-9207-709e5ab8cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:35.120111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9089-574c-4e6c-9207-709e5ab8cb5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:35.181985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f9089-574c-4e6c-9207-709e5ab8cb5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:35.183441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f9089-574c-4e6c-9207-709e5ab8cb5e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:35.273350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 586/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:13:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:13:35.279170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c73a5-cb9a-4386-97ed-0f42719523e0 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:35.373734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c73a5-cb9a-4386-97ed-0f42719523e0 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:35.404545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906223a-dce6-4466-b60f-081559bda7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:35.405401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906223a-dce6-4466-b60f-081559bda7f2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:35.405686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906223a-dce6-4466-b60f-081559bda7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:35.405963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906223a-dce6-4466-b60f-081559bda7f2 None admin] PATH_INFO: `/v3/projects/91372cc51abb4ebc83f724fe2661ac5e` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:35.407160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906223a-dce6-4466-b60f-081559bda7f2 None admin] RBAC: Authorizing `identity:get_project(project_id=91372cc51abb4ebc83f724fe2661ac5e)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:35.408580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906223a-dce6-4466-b60f-081559bda7f2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:35.410820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 613/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Mar 10 17:13:35 2022] GET /identity/v3/projects/91372cc51abb4ebc83f724fe2661ac5e => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:13:35.417045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f9089-574c-4e6c-9207-709e5ab8cb5e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:13:35.509986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f9089-574c-4e6c-9207-709e5ab8cb5e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:13:35.541986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62930a-a533-4a01-86d7-d6ea9e550994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:13:35.542656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62930a-a533-4a01-86d7-d6ea9e550994 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:13:35.542940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62930a-a533-4a01-86d7-d6ea9e550994 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:13:35.543217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62930a-a533-4a01-86d7-d6ea9e550994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:13:35.544027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62930a-a533-4a01-86d7-d6ea9e550994 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=91372cc51abb4ebc83f724fe2661ac5e, user.id=ffd9e99fc06f4618904324bc75374e5a) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:13:35.544586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62930a-a533-4a01-86d7-d6ea9e550994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:13:35.545996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62930a-a533-4a01-86d7-d6ea9e550994 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:13:35.551936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 587/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:13:35 2022] GET /identity/v3/role_assignments?user.id=ffd9e99fc06f4618904324bc75374e5a&scope.project.id=91372cc51abb4ebc83f724fe2661ac5e&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:36.816364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd738-eab1-4e3d-be33-44fd28b0a8d2 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:36.817042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd738-eab1-4e3d-be33-44fd28b0a8d2 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:36.817042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd738-eab1-4e3d-be33-44fd28b0a8d2 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:36.819058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 614/1201] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:14:36.824740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c77252-b071-4d10-ba77-3ceb0f28ea6b None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:36.825251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c77252-b071-4d10-ba77-3ceb0f28ea6b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:36.825339 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c77252-b071-4d10-ba77-3ceb0f28ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:36.843026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-15c77252-b071-4d10-ba77-3ceb0f28ea6b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:14:36.844205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-15c77252-b071-4d10-ba77-3ceb0f28ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:14:36.922192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 588/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:14:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:14:36.947185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dd738-eab1-4e3d-be33-44fd28b0a8d2 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:37.072165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dd738-eab1-4e3d-be33-44fd28b0a8d2 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:37.110118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51e43e-4dc8-466b-8db8-bfcb2fd4da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:37.110961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51e43e-4dc8-466b-8db8-bfcb2fd4da32 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:37.111232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51e43e-4dc8-466b-8db8-bfcb2fd4da32 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:37.111506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51e43e-4dc8-466b-8db8-bfcb2fd4da32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:37.130600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51e43e-4dc8-466b-8db8-bfcb2fd4da32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:37.132403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51e43e-4dc8-466b-8db8-bfcb2fd4da32 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:37.157742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-8e51e43e-4dc8-466b-8db8-bfcb2fd4da32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:37.159588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 615/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:37.167501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c77252-b071-4d10-ba77-3ceb0f28ea6b None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:37.281955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c77252-b071-4d10-ba77-3ceb0f28ea6b None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:37.325444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffd2b1-35f4-4795-9a43-e9428cb3e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:37.326089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffd2b1-35f4-4795-9a43-e9428cb3e396 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:37.326690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffd2b1-35f4-4795-9a43-e9428cb3e396 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:37.327084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffd2b1-35f4-4795-9a43-e9428cb3e396 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:37.328190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffd2b1-35f4-4795-9a43-e9428cb3e396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:37.328642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffd2b1-35f4-4795-9a43-e9428cb3e396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:37.330684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffd2b1-35f4-4795-9a43-e9428cb3e396 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:37.343891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 589/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:37.349939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51e43e-4dc8-466b-8db8-bfcb2fd4da32 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:37.471836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51e43e-4dc8-466b-8db8-bfcb2fd4da32 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:37.512302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612c9f9-74aa-45a3-bb9f-945b3fa0acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:37.513233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612c9f9-74aa-45a3-bb9f-945b3fa0acb8 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:37.513534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612c9f9-74aa-45a3-bb9f-945b3fa0acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:37.513796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612c9f9-74aa-45a3-bb9f-945b3fa0acb8 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:37.514708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612c9f9-74aa-45a3-bb9f-945b3fa0acb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:37.516442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612c9f9-74aa-45a3-bb9f-945b3fa0acb8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:37.546359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 616/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Mar 10 17:14:37 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:14:40.073884 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd5dac-2e51-4c5a-b934-8857daca88da None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:40.074439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd5dac-2e51-4c5a-b934-8857daca88da None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:40.074527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd5dac-2e51-4c5a-b934-8857daca88da None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:40.076366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 590/1206] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:14:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:14:40.082828 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812148-f31b-4c8c-9036-b7d0b9baf653 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:40.083280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812148-f31b-4c8c-9036-b7d0b9baf653 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:40.083386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812148-f31b-4c8c-9036-b7d0b9baf653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:40.102075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d1812148-f31b-4c8c-9036-b7d0b9baf653 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:14:40.103475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d1812148-f31b-4c8c-9036-b7d0b9baf653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:14:40.178470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 617/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:14:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:14:40.201979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd5dac-2e51-4c5a-b934-8857daca88da None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:40.309361 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd5dac-2e51-4c5a-b934-8857daca88da None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:40.347933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed617-410e-4a5c-b03f-570d50c06143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:40.348710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed617-410e-4a5c-b03f-570d50c06143 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:40.348991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed617-410e-4a5c-b03f-570d50c06143 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:40.349314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed617-410e-4a5c-b03f-570d50c06143 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:40.360355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bed617-410e-4a5c-b03f-570d50c06143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:14:40.368444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-b7bed617-410e-4a5c-b03f-570d50c06143 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:14:40.369936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 591/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:14:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:40.376328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1812148-f31b-4c8c-9036-b7d0b9baf653 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:40.481253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1812148-f31b-4c8c-9036-b7d0b9baf653 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:40.519979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780c7e-4927-40e5-b418-82ed98897e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:40.520804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780c7e-4927-40e5-b418-82ed98897e38 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:40.521267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780c7e-4927-40e5-b418-82ed98897e38 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:40.521482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780c7e-4927-40e5-b418-82ed98897e38 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:40.522418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780c7e-4927-40e5-b418-82ed98897e38 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:40.524118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780c7e-4927-40e5-b418-82ed98897e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:40.524231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780c7e-4927-40e5-b418-82ed98897e38 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:40.538482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 618/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:40.540015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed617-410e-4a5c-b03f-570d50c06143 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:40.648594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed617-410e-4a5c-b03f-570d50c06143 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:40.686953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c010da0-dc24-4002-b0ac-c1eaa1673b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:40.687800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010da0-dc24-4002-b0ac-c1eaa1673b4e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:40.688078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010da0-dc24-4002-b0ac-c1eaa1673b4e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:40.688353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010da0-dc24-4002-b0ac-c1eaa1673b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:40.699741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c010da0-dc24-4002-b0ac-c1eaa1673b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:40.701189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c010da0-dc24-4002-b0ac-c1eaa1673b4e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:40.721515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-9c010da0-dc24-4002-b0ac-c1eaa1673b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:40.728112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 592/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:40.729141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780c7e-4927-40e5-b418-82ed98897e38 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:40.849502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780c7e-4927-40e5-b418-82ed98897e38 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:40.887384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6675a08-45b9-4e70-9df3-50196379f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:40.888063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6675a08-45b9-4e70-9df3-50196379f4f2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:40.888349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6675a08-45b9-4e70-9df3-50196379f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:40.888623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6675a08-45b9-4e70-9df3-50196379f4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:40.889340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6675a08-45b9-4e70-9df3-50196379f4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:40.889646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6675a08-45b9-4e70-9df3-50196379f4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:40.891025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6675a08-45b9-4e70-9df3-50196379f4f2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:40.907827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 619/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:40.908888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c010da0-dc24-4002-b0ac-c1eaa1673b4e None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:41.025110 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c010da0-dc24-4002-b0ac-c1eaa1673b4e None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:41.064353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c47fb-fc4c-423d-a37c-0394ede9f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:41.065146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c47fb-fc4c-423d-a37c-0394ede9f342 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:41.065478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c47fb-fc4c-423d-a37c-0394ede9f342 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:41.066354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c47fb-fc4c-423d-a37c-0394ede9f342 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:41.074451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c47fb-fc4c-423d-a37c-0394ede9f342 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:41.076159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c47fb-fc4c-423d-a37c-0394ede9f342 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:41.093792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-398c47fb-fc4c-423d-a37c-0394ede9f342 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 17:14:41.095540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 593/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:41.101655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6675a08-45b9-4e70-9df3-50196379f4f2 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:41.209521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6675a08-45b9-4e70-9df3-50196379f4f2 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:41.246197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ae8d9-63e5-4aa1-a221-35c1b32c50e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:41.248037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ae8d9-63e5-4aa1-a221-35c1b32c50e3 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:41.248336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ae8d9-63e5-4aa1-a221-35c1b32c50e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:41.248615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ae8d9-63e5-4aa1-a221-35c1b32c50e3 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:41.249611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ae8d9-63e5-4aa1-a221-35c1b32c50e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:41.249922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ae8d9-63e5-4aa1-a221-35c1b32c50e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:41.251460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ae8d9-63e5-4aa1-a221-35c1b32c50e3 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:41.269844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 620/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Mar 10 17:14:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:14:41.275430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c47fb-fc4c-423d-a37c-0394ede9f342 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:41.380421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c47fb-fc4c-423d-a37c-0394ede9f342 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:41.412682 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81cdef-576f-4d6a-bebf-77d6279f7d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:41.413322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81cdef-576f-4d6a-bebf-77d6279f7d24 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:41.413625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81cdef-576f-4d6a-bebf-77d6279f7d24 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:41.413904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81cdef-576f-4d6a-bebf-77d6279f7d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:41.484169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81cdef-576f-4d6a-bebf-77d6279f7d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:41.485631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81cdef-576f-4d6a-bebf-77d6279f7d24 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:41.599274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 594/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:14:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 10 17:14:41.605271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ae8d9-63e5-4aa1-a221-35c1b32c50e3 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:41.707944 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ae8d9-63e5-4aa1-a221-35c1b32c50e3 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:41.747704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69ef09-0f37-42b8-b37c-33ab6bd8db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:41.748571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69ef09-0f37-42b8-b37c-33ab6bd8db6c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:41.748854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69ef09-0f37-42b8-b37c-33ab6bd8db6c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:41.749166 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69ef09-0f37-42b8-b37c-33ab6bd8db6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:41.760032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69ef09-0f37-42b8-b37c-33ab6bd8db6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:41.761592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69ef09-0f37-42b8-b37c-33ab6bd8db6c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:41.778144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-0a69ef09-0f37-42b8-b37c-33ab6bd8db6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:41.780153 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 621/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:41.787263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81cdef-576f-4d6a-bebf-77d6279f7d24 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:41.904498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81cdef-576f-4d6a-bebf-77d6279f7d24 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:41.948318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eb837-ebd7-468b-899d-32d144fe1006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:41.949681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eb837-ebd7-468b-899d-32d144fe1006 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:41.950036 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eb837-ebd7-468b-899d-32d144fe1006 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:41.950313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eb837-ebd7-468b-899d-32d144fe1006 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:41.951133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039eb837-ebd7-468b-899d-32d144fe1006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:41.951402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039eb837-ebd7-468b-899d-32d144fe1006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:41.952983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039eb837-ebd7-468b-899d-32d144fe1006 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:41.965828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 595/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:41.971653 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69ef09-0f37-42b8-b37c-33ab6bd8db6c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:42.087961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69ef09-0f37-42b8-b37c-33ab6bd8db6c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:42.129106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc46f2d-f2fa-4efc-be41-5b8713602610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:42.130088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc46f2d-f2fa-4efc-be41-5b8713602610 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:42.130543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc46f2d-f2fa-4efc-be41-5b8713602610 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:42.130930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc46f2d-f2fa-4efc-be41-5b8713602610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:42.139328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc46f2d-f2fa-4efc-be41-5b8713602610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:42.141027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc46f2d-f2fa-4efc-be41-5b8713602610 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:42.156703 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-2fc46f2d-f2fa-4efc-be41-5b8713602610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:14:42.158042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 622/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:14:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:42.165085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eb837-ebd7-468b-899d-32d144fe1006 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:42.273853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eb837-ebd7-468b-899d-32d144fe1006 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:42.320293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc47134-d990-4d48-b06e-bcd9d8746fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:42.321077 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc47134-d990-4d48-b06e-bcd9d8746fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:42.321341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc47134-d990-4d48-b06e-bcd9d8746fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:42.321675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc47134-d990-4d48-b06e-bcd9d8746fb9 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:42.322610 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc47134-d990-4d48-b06e-bcd9d8746fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:42.322960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc47134-d990-4d48-b06e-bcd9d8746fb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:42.324575 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc47134-d990-4d48-b06e-bcd9d8746fb9 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:42.342207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 596/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:42.345890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc46f2d-f2fa-4efc-be41-5b8713602610 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:42.470003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc46f2d-f2fa-4efc-be41-5b8713602610 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:42.508347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81431492-1011-40e9-b4a6-f7c7b028ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:42.509276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81431492-1011-40e9-b4a6-f7c7b028ff33 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:42.509564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81431492-1011-40e9-b4a6-f7c7b028ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:42.509839 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81431492-1011-40e9-b4a6-f7c7b028ff33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:42.510707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81431492-1011-40e9-b4a6-f7c7b028ff33 None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=a35ae873d42b490cae4dd610f2ac6a60) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:42.511030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81431492-1011-40e9-b4a6-f7c7b028ff33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:42.512872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81431492-1011-40e9-b4a6-f7c7b028ff33 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:42.520919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 623/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:14:42 2022] GET /identity/v3/role_assignments?user.id=a35ae873d42b490cae4dd610f2ac6a60&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:44.894401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcad1e0-02f5-4a26-9b34-12d8a03d1cb5 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:44.894967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcad1e0-02f5-4a26-9b34-12d8a03d1cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:44.894967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcad1e0-02f5-4a26-9b34-12d8a03d1cb5 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:44.896708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 597/1220] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:14:44.902021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856dde2-c85b-45a0-8ceb-11b28b854f5a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:44.902461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856dde2-c85b-45a0-8ceb-11b28b854f5a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:44.902602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856dde2-c85b-45a0-8ceb-11b28b854f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:44.921462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d856dde2-c85b-45a0-8ceb-11b28b854f5a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:14:44.922828 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d856dde2-c85b-45a0-8ceb-11b28b854f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:14:44.995541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 624/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:14:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:14:45.021596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcad1e0-02f5-4a26-9b34-12d8a03d1cb5 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:45.130765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcad1e0-02f5-4a26-9b34-12d8a03d1cb5 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:45.167334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc12ed7-e147-43f4-a94f-55ae9c6d8ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:45.168651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc12ed7-e147-43f4-a94f-55ae9c6d8ff7 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:45.168935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc12ed7-e147-43f4-a94f-55ae9c6d8ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:45.169285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc12ed7-e147-43f4-a94f-55ae9c6d8ff7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:45.180417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc12ed7-e147-43f4-a94f-55ae9c6d8ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:14:45.187946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-ebc12ed7-e147-43f4-a94f-55ae9c6d8ff7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:14:45.189114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 598/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:14:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:45.196221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856dde2-c85b-45a0-8ceb-11b28b854f5a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:45.299804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856dde2-c85b-45a0-8ceb-11b28b854f5a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:45.335811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a40484-826d-480b-a864-7374cd45d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:45.336560 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a40484-826d-480b-a864-7374cd45d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:45.336913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a40484-826d-480b-a864-7374cd45d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:45.337234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a40484-826d-480b-a864-7374cd45d9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:45.338060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a40484-826d-480b-a864-7374cd45d9e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:45.338471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a40484-826d-480b-a864-7374cd45d9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:45.340025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a40484-826d-480b-a864-7374cd45d9e0 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:45.349698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 625/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:14:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:14:45.356077 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc12ed7-e147-43f4-a94f-55ae9c6d8ff7 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:45.466938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc12ed7-e147-43f4-a94f-55ae9c6d8ff7 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:45.502192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc3754-7a03-4a0f-ba7f-5a691d681ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:45.503527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3754-7a03-4a0f-ba7f-5a691d681ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:45.503818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3754-7a03-4a0f-ba7f-5a691d681ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:45.504171 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3754-7a03-4a0f-ba7f-5a691d681ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:45.515202 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc3754-7a03-4a0f-ba7f-5a691d681ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:45.516632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc3754-7a03-4a0f-ba7f-5a691d681ed8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:45.533068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-36cc3754-7a03-4a0f-ba7f-5a691d681ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:45.534277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 599/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:45.540522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a40484-826d-480b-a864-7374cd45d9e0 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:45.647225 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a40484-826d-480b-a864-7374cd45d9e0 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:45.681018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cb0a2-c5aa-4994-bbcd-21a7e2c50f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:45.681709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cb0a2-c5aa-4994-bbcd-21a7e2c50f89 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:45.681992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cb0a2-c5aa-4994-bbcd-21a7e2c50f89 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:45.682303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cb0a2-c5aa-4994-bbcd-21a7e2c50f89 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:45.683010 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cb0a2-c5aa-4994-bbcd-21a7e2c50f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:45.683311 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cb0a2-c5aa-4994-bbcd-21a7e2c50f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:45.684657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cb0a2-c5aa-4994-bbcd-21a7e2c50f89 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:45.697590 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 626/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:45.703515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc3754-7a03-4a0f-ba7f-5a691d681ed8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:45.810477 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc3754-7a03-4a0f-ba7f-5a691d681ed8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:45.851315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ab19b-5bb4-4aaa-a0cf-15f3cfaa3292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:45.852157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ab19b-5bb4-4aaa-a0cf-15f3cfaa3292 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:45.852468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ab19b-5bb4-4aaa-a0cf-15f3cfaa3292 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:45.852720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ab19b-5bb4-4aaa-a0cf-15f3cfaa3292 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:45.861060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ab19b-5bb4-4aaa-a0cf-15f3cfaa3292 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:45.863238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ab19b-5bb4-4aaa-a0cf-15f3cfaa3292 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:45.879230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-d15ab19b-5bb4-4aaa-a0cf-15f3cfaa3292 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 17:14:45.880495 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 600/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:45.886583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cb0a2-c5aa-4994-bbcd-21a7e2c50f89 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:45.991261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cb0a2-c5aa-4994-bbcd-21a7e2c50f89 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:46.026069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4722625-d8d9-49b3-b827-508e2d3710ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:46.026909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4722625-d8d9-49b3-b827-508e2d3710ee None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:46.027285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4722625-d8d9-49b3-b827-508e2d3710ee None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:46.027634 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4722625-d8d9-49b3-b827-508e2d3710ee None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:46.028465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4722625-d8d9-49b3-b827-508e2d3710ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:46.028772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4722625-d8d9-49b3-b827-508e2d3710ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:46.030210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4722625-d8d9-49b3-b827-508e2d3710ee None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:46.048530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 627/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Mar 10 17:14:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:46.055554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ab19b-5bb4-4aaa-a0cf-15f3cfaa3292 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:46.170330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ab19b-5bb4-4aaa-a0cf-15f3cfaa3292 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:46.203406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feffb58-f355-403f-a28a-b7846a0e797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:46.204198 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feffb58-f355-403f-a28a-b7846a0e797d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:46.204477 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feffb58-f355-403f-a28a-b7846a0e797d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:46.204751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feffb58-f355-403f-a28a-b7846a0e797d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:46.215671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feffb58-f355-403f-a28a-b7846a0e797d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:46.217186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feffb58-f355-403f-a28a-b7846a0e797d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:46.233493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-2feffb58-f355-403f-a28a-b7846a0e797d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:46.234870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 601/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:46.241017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4722625-d8d9-49b3-b827-508e2d3710ee None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:46.347882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4722625-d8d9-49b3-b827-508e2d3710ee None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:46.385173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc9610-24eb-43e3-ba5d-be51022579ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:46.385845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc9610-24eb-43e3-ba5d-be51022579ed None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:46.386138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc9610-24eb-43e3-ba5d-be51022579ed None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:46.386416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc9610-24eb-43e3-ba5d-be51022579ed None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:46.387139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc9610-24eb-43e3-ba5d-be51022579ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:46.387472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc9610-24eb-43e3-ba5d-be51022579ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:46.388791 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc9610-24eb-43e3-ba5d-be51022579ed None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:46.400369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 628/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:46.406575 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feffb58-f355-403f-a28a-b7846a0e797d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:46.526133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feffb58-f355-403f-a28a-b7846a0e797d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:46.562502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b4121-20a1-4641-a45f-db7a46d1881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:46.563306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b4121-20a1-4641-a45f-db7a46d1881d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:46.563634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b4121-20a1-4641-a45f-db7a46d1881d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:46.563969 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b4121-20a1-4641-a45f-db7a46d1881d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:46.570952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b4121-20a1-4641-a45f-db7a46d1881d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:46.572523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b4121-20a1-4641-a45f-db7a46d1881d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:46.587138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-727b4121-20a1-4641-a45f-db7a46d1881d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:14:46.588315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 602/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:46.594443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc9610-24eb-43e3-ba5d-be51022579ed None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:46.699687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc9610-24eb-43e3-ba5d-be51022579ed None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:46.733192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ac034-bb1b-4224-b33b-52bb898d8d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:46.733852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac034-bb1b-4224-b33b-52bb898d8d08 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:46.734164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac034-bb1b-4224-b33b-52bb898d8d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:46.734443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac034-bb1b-4224-b33b-52bb898d8d08 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:46.735221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac034-bb1b-4224-b33b-52bb898d8d08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:46.735529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac034-bb1b-4224-b33b-52bb898d8d08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:46.736939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac034-bb1b-4224-b33b-52bb898d8d08 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:46.748593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 629/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:46.754920 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b4121-20a1-4641-a45f-db7a46d1881d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:46.876725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b4121-20a1-4641-a45f-db7a46d1881d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:46.914841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe9b87-fe2f-4ed8-ba46-1e9e9e98a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:46.915728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9b87-fe2f-4ed8-ba46-1e9e9e98a246 None admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:46.916021 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9b87-fe2f-4ed8-ba46-1e9e9e98a246 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:46.916286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9b87-fe2f-4ed8-ba46-1e9e9e98a246 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/a35ae873d42b490cae4dd610f2ac6a60/roles/f7e74696bb6d4f4e8571a49a6c5335c8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:46.933353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe9b87-fe2f-4ed8-ba46-1e9e9e98a246 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=a35ae873d42b490cae4dd610f2ac6a60, role_id=f7e74696bb6d4f4e8571a49a6c5335c8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:46.935247 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe9b87-fe2f-4ed8-ba46-1e9e9e98a246 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:46.949805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 603/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:14:46 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/a35ae873d42b490cae4dd610f2ac6a60/roles/f7e74696bb6d4f4e8571a49a6c5335c8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:14:49.317159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a972fb-16e5-4528-949a-ce383ca0ee5b None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:49.317639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a972fb-16e5-4528-949a-ce383ca0ee5b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:49.317748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a972fb-16e5-4528-949a-ce383ca0ee5b None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:49.319638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 630/1233] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:14:49.325349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae4a8c-b67d-478d-88a7-91c51aa3b2d1 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:49.325770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae4a8c-b67d-478d-88a7-91c51aa3b2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:49.325906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae4a8c-b67d-478d-88a7-91c51aa3b2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:49.343214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-cdae4a8c-b67d-478d-88a7-91c51aa3b2d1 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:14:49.344638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cdae4a8c-b67d-478d-88a7-91c51aa3b2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:14:49.416055 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 604/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:14:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:14:49.440123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a972fb-16e5-4528-949a-ce383ca0ee5b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:49.553742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a972fb-16e5-4528-949a-ce383ca0ee5b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:49.592021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5647e4-5785-4758-8e8b-3979cf87c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:49.592983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5647e4-5785-4758-8e8b-3979cf87c00f None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:49.593270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5647e4-5785-4758-8e8b-3979cf87c00f None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:49.593545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5647e4-5785-4758-8e8b-3979cf87c00f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:49.605930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5647e4-5785-4758-8e8b-3979cf87c00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:14:49.612930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-2e5647e4-5785-4758-8e8b-3979cf87c00f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 17:14:49.614175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 631/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Mar 10 17:14:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:49.620840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae4a8c-b67d-478d-88a7-91c51aa3b2d1 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:49.735852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae4a8c-b67d-478d-88a7-91c51aa3b2d1 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:49.772078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2662f5-bd6c-4e4e-8910-b4ab370c0b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:49.772758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2662f5-bd6c-4e4e-8910-b4ab370c0b42 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:49.773060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2662f5-bd6c-4e4e-8910-b4ab370c0b42 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:49.773388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2662f5-bd6c-4e4e-8910-b4ab370c0b42 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:49.774224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2662f5-bd6c-4e4e-8910-b4ab370c0b42 None admin] RBAC: Adding query filter params (name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:49.774542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2662f5-bd6c-4e4e-8910-b4ab370c0b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:49.776050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2662f5-bd6c-4e4e-8910-b4ab370c0b42 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:49.784650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 605/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Mar 10 17:14:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:49.790716 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5647e4-5785-4758-8e8b-3979cf87c00f None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:49.901969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5647e4-5785-4758-8e8b-3979cf87c00f None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:49.935682 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c9cd0-4dab-4f56-ad41-70236b558b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:49.936474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c9cd0-4dab-4f56-ad41-70236b558b0c None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:49.936756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c9cd0-4dab-4f56-ad41-70236b558b0c None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:49.937022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c9cd0-4dab-4f56-ad41-70236b558b0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:49.947618 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c9cd0-4dab-4f56-ad41-70236b558b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:49.949054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c9cd0-4dab-4f56-ad41-70236b558b0c None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:49.965187 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-d17c9cd0-4dab-4f56-ad41-70236b558b0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:49.966391 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 632/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:49.972686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2662f5-bd6c-4e4e-8910-b4ab370c0b42 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:50.079049 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2662f5-bd6c-4e4e-8910-b4ab370c0b42 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:50.113227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97dd8-b5ee-43d7-a38d-25abe0cacc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:50.113895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97dd8-b5ee-43d7-a38d-25abe0cacc77 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:50.114208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97dd8-b5ee-43d7-a38d-25abe0cacc77 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:50.114488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97dd8-b5ee-43d7-a38d-25abe0cacc77 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:50.115232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef97dd8-b5ee-43d7-a38d-25abe0cacc77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:50.115538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef97dd8-b5ee-43d7-a38d-25abe0cacc77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:50.116898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef97dd8-b5ee-43d7-a38d-25abe0cacc77 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:50.129923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 606/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:14:50.135753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c9cd0-4dab-4f56-ad41-70236b558b0c None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:50.246451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c9cd0-4dab-4f56-ad41-70236b558b0c None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:50.282963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0f4a-d1c2-49da-8ded-a3cc302abade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:50.283836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0f4a-d1c2-49da-8ded-a3cc302abade None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:50.284061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0f4a-d1c2-49da-8ded-a3cc302abade None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:50.284876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0f4a-d1c2-49da-8ded-a3cc302abade None admin] PATH_INFO: `/v3/users/placement` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:50.294327 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b0f4a-d1c2-49da-8ded-a3cc302abade None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:50.295791 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b0f4a-d1c2-49da-8ded-a3cc302abade None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:50.309285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-027b0f4a-d1c2-49da-8ded-a3cc302abade None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 17:14:50.310495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 633/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:50.316234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97dd8-b5ee-43d7-a38d-25abe0cacc77 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:50.427161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97dd8-b5ee-43d7-a38d-25abe0cacc77 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:50.462617 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef32e59-c554-4061-8495-501c5c919310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:50.463377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef32e59-c554-4061-8495-501c5c919310 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:50.463784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef32e59-c554-4061-8495-501c5c919310 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:50.464165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef32e59-c554-4061-8495-501c5c919310 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:50.465129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef32e59-c554-4061-8495-501c5c919310 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:50.465470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef32e59-c554-4061-8495-501c5c919310 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:50.467301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef32e59-c554-4061-8495-501c5c919310 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:50.487379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 607/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Mar 10 17:14:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:50.493805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0f4a-d1c2-49da-8ded-a3cc302abade None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:50.600140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0f4a-d1c2-49da-8ded-a3cc302abade None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:50.634777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d5115-1461-45b0-838a-a022859fe693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:50.635619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d5115-1461-45b0-838a-a022859fe693 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:50.635803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d5115-1461-45b0-838a-a022859fe693 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:50.636156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d5115-1461-45b0-838a-a022859fe693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:50.704155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d5115-1461-45b0-838a-a022859fe693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:50.705610 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d5115-1461-45b0-838a-a022859fe693 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:50.810132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 634/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:14:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:14:50.816651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef32e59-c554-4061-8495-501c5c919310 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:50.932937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef32e59-c554-4061-8495-501c5c919310 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:50.970519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad0d6-6b3f-4450-8587-5a6d87bc7b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:50.971608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad0d6-6b3f-4450-8587-5a6d87bc7b2f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:50.972030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad0d6-6b3f-4450-8587-5a6d87bc7b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:50.972367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad0d6-6b3f-4450-8587-5a6d87bc7b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:50.982965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dad0d6-6b3f-4450-8587-5a6d87bc7b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:50.984607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dad0d6-6b3f-4450-8587-5a6d87bc7b2f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:51.003752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-29dad0d6-6b3f-4450-8587-5a6d87bc7b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:51.004984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 608/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:51.011044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d5115-1461-45b0-838a-a022859fe693 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:51.119724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d5115-1461-45b0-838a-a022859fe693 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:51.155829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed9e84-3506-4655-a45d-15d90ae49c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:51.156644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed9e84-3506-4655-a45d-15d90ae49c2e None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:51.156991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed9e84-3506-4655-a45d-15d90ae49c2e None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:51.157307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed9e84-3506-4655-a45d-15d90ae49c2e None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:51.158232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed9e84-3506-4655-a45d-15d90ae49c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:51.158690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed9e84-3506-4655-a45d-15d90ae49c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:51.160409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed9e84-3506-4655-a45d-15d90ae49c2e None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:51.174294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 635/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:51.180625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad0d6-6b3f-4450-8587-5a6d87bc7b2f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:51.287598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad0d6-6b3f-4450-8587-5a6d87bc7b2f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:51.321360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4c12a-30c0-4923-9d7d-19f547d1603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:51.322162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4c12a-30c0-4923-9d7d-19f547d1603b None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:51.322449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4c12a-30c0-4923-9d7d-19f547d1603b None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:51.322728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4c12a-30c0-4923-9d7d-19f547d1603b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:51.329808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4c12a-30c0-4923-9d7d-19f547d1603b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:51.331308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4c12a-30c0-4923-9d7d-19f547d1603b None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:51.345823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-c7d4c12a-30c0-4923-9d7d-19f547d1603b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:14:51.347129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 609/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:14:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:51.353084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed9e84-3506-4655-a45d-15d90ae49c2e None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:51.465942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed9e84-3506-4655-a45d-15d90ae49c2e None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:51.499384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855ed48-db2f-4cbf-973a-bb0d7b304a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:51.500137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855ed48-db2f-4cbf-973a-bb0d7b304a42 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:51.500311 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855ed48-db2f-4cbf-973a-bb0d7b304a42 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:51.500582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855ed48-db2f-4cbf-973a-bb0d7b304a42 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:51.501360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855ed48-db2f-4cbf-973a-bb0d7b304a42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:51.501665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855ed48-db2f-4cbf-973a-bb0d7b304a42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:51.503130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855ed48-db2f-4cbf-973a-bb0d7b304a42 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:51.515448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 636/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:14:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:51.521448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4c12a-30c0-4923-9d7d-19f547d1603b None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:51.626587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4c12a-30c0-4923-9d7d-19f547d1603b None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:51.661700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca57e3b-e85d-4d48-9c53-bc82e01125cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:51.662385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca57e3b-e85d-4d48-9c53-bc82e01125cb None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:51.662668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca57e3b-e85d-4d48-9c53-bc82e01125cb None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:51.662944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca57e3b-e85d-4d48-9c53-bc82e01125cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:51.663763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca57e3b-e85d-4d48-9c53-bc82e01125cb None admin] RBAC: Adding query filter params (role.id=f7e74696bb6d4f4e8571a49a6c5335c8, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=a35ae873d42b490cae4dd610f2ac6a60) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:51.664073 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca57e3b-e85d-4d48-9c53-bc82e01125cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:51.665487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca57e3b-e85d-4d48-9c53-bc82e01125cb None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:51.671561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 610/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:14:51 2022] GET /identity/v3/role_assignments?user.id=a35ae873d42b490cae4dd610f2ac6a60&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=f7e74696bb6d4f4e8571a49a6c5335c8 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:54.311974 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db751d28-0334-4cc6-9f09-03313a92daec None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:54.312506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db751d28-0334-4cc6-9f09-03313a92daec None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:54.312506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db751d28-0334-4cc6-9f09-03313a92daec None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:54.314686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 637/1247] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:14:54.320532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d89fa-b4ab-488c-b48f-7028236d5673 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:54.321107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d89fa-b4ab-488c-b48f-7028236d5673 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:54.321107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d89fa-b4ab-488c-b48f-7028236d5673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:54.339430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-792d89fa-b4ab-488c-b48f-7028236d5673 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:14:54.340658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-792d89fa-b4ab-488c-b48f-7028236d5673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:14:54.411323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 611/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:14:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:14:54.435226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db751d28-0334-4cc6-9f09-03313a92daec None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:54.537922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db751d28-0334-4cc6-9f09-03313a92daec None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:54.573260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7c5e4-4ca6-45d3-a08b-5a5faaaba4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:54.573982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7c5e4-4ca6-45d3-a08b-5a5faaaba4b2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:54.574300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7c5e4-4ca6-45d3-a08b-5a5faaaba4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:54.574578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7c5e4-4ca6-45d3-a08b-5a5faaaba4b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:54.585930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7c5e4-4ca6-45d3-a08b-5a5faaaba4b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:14:54.593073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-87d7c5e4-4ca6-45d3-a08b-5a5faaaba4b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:14:54.594339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 638/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:54.600571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d89fa-b4ab-488c-b48f-7028236d5673 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:54.698804 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d89fa-b4ab-488c-b48f-7028236d5673 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:54.731026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d02a9-cb4f-406e-bdba-af2205fcd35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:54.731684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d02a9-cb4f-406e-bdba-af2205fcd35d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:54.731964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d02a9-cb4f-406e-bdba-af2205fcd35d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:54.732236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d02a9-cb4f-406e-bdba-af2205fcd35d None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:54.732971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d02a9-cb4f-406e-bdba-af2205fcd35d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:54.733275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d02a9-cb4f-406e-bdba-af2205fcd35d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:54.734666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d02a9-cb4f-406e-bdba-af2205fcd35d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:54.743368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 612/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:14:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:54.748986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7c5e4-4ca6-45d3-a08b-5a5faaaba4b2 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:54.857508 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7c5e4-4ca6-45d3-a08b-5a5faaaba4b2 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:54.894960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db863e4-a349-4b29-a990-9173f4e1d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:54.895764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db863e4-a349-4b29-a990-9173f4e1d81d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:54.896047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db863e4-a349-4b29-a990-9173f4e1d81d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:54.896320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db863e4-a349-4b29-a990-9173f4e1d81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:54.906792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db863e4-a349-4b29-a990-9173f4e1d81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:54.908214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db863e4-a349-4b29-a990-9173f4e1d81d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:54.924937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-9db863e4-a349-4b29-a990-9173f4e1d81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:54.926132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 639/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:54.931778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d02a9-cb4f-406e-bdba-af2205fcd35d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:55.024123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d02a9-cb4f-406e-bdba-af2205fcd35d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:55.055362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2b5cb-14ea-41b0-bd51-45520757e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:55.056001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2b5cb-14ea-41b0-bd51-45520757e774 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:55.056283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2b5cb-14ea-41b0-bd51-45520757e774 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:55.056556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2b5cb-14ea-41b0-bd51-45520757e774 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:55.057261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2b5cb-14ea-41b0-bd51-45520757e774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:55.057561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2b5cb-14ea-41b0-bd51-45520757e774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:55.058933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2b5cb-14ea-41b0-bd51-45520757e774 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:55.069797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 613/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:55.075118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db863e4-a349-4b29-a990-9173f4e1d81d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:55.170642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db863e4-a349-4b29-a990-9173f4e1d81d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:55.203115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ec4aa-6f91-4720-8d22-2737dbe54b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:55.203918 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ec4aa-6f91-4720-8d22-2737dbe54b5d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:55.204208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ec4aa-6f91-4720-8d22-2737dbe54b5d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:55.204486 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ec4aa-6f91-4720-8d22-2737dbe54b5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:55.212633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ec4aa-6f91-4720-8d22-2737dbe54b5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:55.214053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ec4aa-6f91-4720-8d22-2737dbe54b5d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:55.226986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-7a1ec4aa-6f91-4720-8d22-2737dbe54b5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 17:14:55.228118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 640/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:55.233808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2b5cb-14ea-41b0-bd51-45520757e774 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:55.325661 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2b5cb-14ea-41b0-bd51-45520757e774 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:55.357165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38f513-fd27-47f3-b62b-79a964633f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:55.357816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f513-fd27-47f3-b62b-79a964633f4a None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:55.358095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f513-fd27-47f3-b62b-79a964633f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:55.358395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f513-fd27-47f3-b62b-79a964633f4a None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:55.359208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38f513-fd27-47f3-b62b-79a964633f4a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:55.359510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38f513-fd27-47f3-b62b-79a964633f4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:55.360922 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38f513-fd27-47f3-b62b-79a964633f4a None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:55.376640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 614/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Mar 10 17:14:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:55.382681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ec4aa-6f91-4720-8d22-2737dbe54b5d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:55.477429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ec4aa-6f91-4720-8d22-2737dbe54b5d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:55.519870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d31f-0e89-41db-8810-89a8b52e2e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:55.520549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d31f-0e89-41db-8810-89a8b52e2e65 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:55.520970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d31f-0e89-41db-8810-89a8b52e2e65 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:55.521380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d31f-0e89-41db-8810-89a8b52e2e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:55.592554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d31f-0e89-41db-8810-89a8b52e2e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:55.593970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d31f-0e89-41db-8810-89a8b52e2e65 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:55.683592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 641/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:14:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:14:55.689476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38f513-fd27-47f3-b62b-79a964633f4a None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:55.780567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38f513-fd27-47f3-b62b-79a964633f4a None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:55.812178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10b90b-c5b7-441c-a332-167be83d3bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:55.812961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10b90b-c5b7-441c-a332-167be83d3bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:55.813245 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10b90b-c5b7-441c-a332-167be83d3bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:55.813519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10b90b-c5b7-441c-a332-167be83d3bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:55.823983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10b90b-c5b7-441c-a332-167be83d3bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:55.825549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10b90b-c5b7-441c-a332-167be83d3bc8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:55.842911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-ad10b90b-c5b7-441c-a332-167be83d3bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:55.844187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 615/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:55.851904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d31f-0e89-41db-8810-89a8b52e2e65 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:55.947159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d31f-0e89-41db-8810-89a8b52e2e65 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:55.978329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a674357-0950-4e1d-b0b0-59a38d83d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:55.978979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674357-0950-4e1d-b0b0-59a38d83d61d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:55.979258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674357-0950-4e1d-b0b0-59a38d83d61d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:55.979531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674357-0950-4e1d-b0b0-59a38d83d61d None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:55.980233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a674357-0950-4e1d-b0b0-59a38d83d61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:55.980537 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a674357-0950-4e1d-b0b0-59a38d83d61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:55.981883 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a674357-0950-4e1d-b0b0-59a38d83d61d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:55.992859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 642/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:55.998464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10b90b-c5b7-441c-a332-167be83d3bc8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:56.091284 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10b90b-c5b7-441c-a332-167be83d3bc8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:56.125183 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf0843-33c6-48fc-83cf-19b02d8f6f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:56.125957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf0843-33c6-48fc-83cf-19b02d8f6f35 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:56.126269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf0843-33c6-48fc-83cf-19b02d8f6f35 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:56.126546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf0843-33c6-48fc-83cf-19b02d8f6f35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:56.132874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf0843-33c6-48fc-83cf-19b02d8f6f35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:56.134328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf0843-33c6-48fc-83cf-19b02d8f6f35 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:56.146924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-6ddf0843-33c6-48fc-83cf-19b02d8f6f35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:14:56.148054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 616/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 17:14:56.153714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a674357-0950-4e1d-b0b0-59a38d83d61d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:56.246397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a674357-0950-4e1d-b0b0-59a38d83d61d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:56.277395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4454f5-21f4-4269-a1f0-3df03e1374a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:56.278031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4454f5-21f4-4269-a1f0-3df03e1374a4 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:56.278342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4454f5-21f4-4269-a1f0-3df03e1374a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:56.278614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4454f5-21f4-4269-a1f0-3df03e1374a4 None admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:56.279373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4454f5-21f4-4269-a1f0-3df03e1374a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:56.279704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4454f5-21f4-4269-a1f0-3df03e1374a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:56.281098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4454f5-21f4-4269-a1f0-3df03e1374a4 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:56.292593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 643/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:56.298690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf0843-33c6-48fc-83cf-19b02d8f6f35 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:56.392949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf0843-33c6-48fc-83cf-19b02d8f6f35 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:56.423450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64589ab-2d60-4ab2-bbf4-21e2c69a2e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:56.424079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64589ab-2d60-4ab2-bbf4-21e2c69a2e78 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:56.424361 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64589ab-2d60-4ab2-bbf4-21e2c69a2e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:56.425203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64589ab-2d60-4ab2-bbf4-21e2c69a2e78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:56.426011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64589ab-2d60-4ab2-bbf4-21e2c69a2e78 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=a35ae873d42b490cae4dd610f2ac6a60) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:56.426354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64589ab-2d60-4ab2-bbf4-21e2c69a2e78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:56.427754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64589ab-2d60-4ab2-bbf4-21e2c69a2e78 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:56.432774 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 617/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:14:56 2022] GET /identity/v3/role_assignments?user.id=a35ae873d42b490cae4dd610f2ac6a60&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:58.671815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828f070-a173-4167-8e3d-9301eebbb2dd None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:58.672307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828f070-a173-4167-8e3d-9301eebbb2dd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:58.672307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828f070-a173-4167-8e3d-9301eebbb2dd None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:58.674035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 644/1261] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:14:58.679154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0e9ab-65c3-4782-ba05-ac42fc14cf1c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:58.679512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0e9ab-65c3-4782-ba05-ac42fc14cf1c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:58.679720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0e9ab-65c3-4782-ba05-ac42fc14cf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:58.695931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-12c0e9ab-65c3-4782-ba05-ac42fc14cf1c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:14:58.697096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-12c0e9ab-65c3-4782-ba05-ac42fc14cf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:14:58.759061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 618/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:14:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:14:58.781375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828f070-a173-4167-8e3d-9301eebbb2dd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:58.884561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828f070-a173-4167-8e3d-9301eebbb2dd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:58.917671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2b42-558d-4fbe-9ba5-db039797c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:58.918482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2b42-558d-4fbe-9ba5-db039797c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:58.918762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2b42-558d-4fbe-9ba5-db039797c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:58.919035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2b42-558d-4fbe-9ba5-db039797c8b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:58.928431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2b42-558d-4fbe-9ba5-db039797c8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:14:58.935250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-f53e2b42-558d-4fbe-9ba5-db039797c8b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:14:58.936405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 645/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:58.943082 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0e9ab-65c3-4782-ba05-ac42fc14cf1c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:59.034711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0e9ab-65c3-4782-ba05-ac42fc14cf1c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:59.066594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75e69-58b9-40bf-b37b-42ab909259e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:59.067243 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75e69-58b9-40bf-b37b-42ab909259e8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:59.067530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75e69-58b9-40bf-b37b-42ab909259e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:59.067806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75e69-58b9-40bf-b37b-42ab909259e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:59.068546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da75e69-58b9-40bf-b37b-42ab909259e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:59.068853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da75e69-58b9-40bf-b37b-42ab909259e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:59.070233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da75e69-58b9-40bf-b37b-42ab909259e8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:59.077777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 619/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:14:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:59.083927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2b42-558d-4fbe-9ba5-db039797c8b4 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:59.176100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2b42-558d-4fbe-9ba5-db039797c8b4 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:59.207253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc60d72-bffa-40e8-a879-e4250b71f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:59.207962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc60d72-bffa-40e8-a879-e4250b71f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:59.208244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc60d72-bffa-40e8-a879-e4250b71f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:59.208516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc60d72-bffa-40e8-a879-e4250b71f3c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:59.218315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc60d72-bffa-40e8-a879-e4250b71f3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:59.219720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc60d72-bffa-40e8-a879-e4250b71f3c5 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:59.235172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-2dc60d72-bffa-40e8-a879-e4250b71f3c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:59.236284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 646/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:59.241788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75e69-58b9-40bf-b37b-42ab909259e8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:59.334636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75e69-58b9-40bf-b37b-42ab909259e8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:59.365365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcfb7c-c6b8-4571-83aa-f384b8e4056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:59.366003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcfb7c-c6b8-4571-83aa-f384b8e4056f None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:59.366325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcfb7c-c6b8-4571-83aa-f384b8e4056f None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:59.366599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcfb7c-c6b8-4571-83aa-f384b8e4056f None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:59.367306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcfb7c-c6b8-4571-83aa-f384b8e4056f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:59.367607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcfb7c-c6b8-4571-83aa-f384b8e4056f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:59.368951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcfb7c-c6b8-4571-83aa-f384b8e4056f None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:59.380444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 620/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:59.385967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc60d72-bffa-40e8-a879-e4250b71f3c5 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:59.478325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc60d72-bffa-40e8-a879-e4250b71f3c5 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:59.510145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0d3ad-6bfc-45ee-a212-329963b26805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:59.510935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0d3ad-6bfc-45ee-a212-329963b26805 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:59.511221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0d3ad-6bfc-45ee-a212-329963b26805 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:59.511502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0d3ad-6bfc-45ee-a212-329963b26805 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:59.519294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0d3ad-6bfc-45ee-a212-329963b26805 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:59.520702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0d3ad-6bfc-45ee-a212-329963b26805 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:59.533570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-9ee0d3ad-6bfc-45ee-a212-329963b26805 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 17:14:59.534735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 647/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:59.540340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcfb7c-c6b8-4571-83aa-f384b8e4056f None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:59.633980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcfb7c-c6b8-4571-83aa-f384b8e4056f None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:59.666317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26a662-9aa6-454f-82fc-73b74e46bea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:59.666967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26a662-9aa6-454f-82fc-73b74e46bea8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:59.667249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26a662-9aa6-454f-82fc-73b74e46bea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:59.667773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26a662-9aa6-454f-82fc-73b74e46bea8 None admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:59.668594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26a662-9aa6-454f-82fc-73b74e46bea8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:59.668894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26a662-9aa6-454f-82fc-73b74e46bea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:59.670329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26a662-9aa6-454f-82fc-73b74e46bea8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:59.686701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 621/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Mar 10 17:14:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:14:59.692120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0d3ad-6bfc-45ee-a212-329963b26805 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:59.784681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0d3ad-6bfc-45ee-a212-329963b26805 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:59.816229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fa190-6664-4187-a8d3-69aa1a53fed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:59.817105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fa190-6664-4187-a8d3-69aa1a53fed1 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:59.817327 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fa190-6664-4187-a8d3-69aa1a53fed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:59.817608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fa190-6664-4187-a8d3-69aa1a53fed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:59.828878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fa190-6664-4187-a8d3-69aa1a53fed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:59.830342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fa190-6664-4187-a8d3-69aa1a53fed1 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:59.849774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-ce3fa190-6664-4187-a8d3-69aa1a53fed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:14:59.851210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 648/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:14:59.857668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26a662-9aa6-454f-82fc-73b74e46bea8 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:14:59.949912 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26a662-9aa6-454f-82fc-73b74e46bea8 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:14:59.981206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab1474-941d-49eb-a96c-07ecd8587192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:14:59.981850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab1474-941d-49eb-a96c-07ecd8587192 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:14:59.982151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab1474-941d-49eb-a96c-07ecd8587192 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:14:59.982431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab1474-941d-49eb-a96c-07ecd8587192 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:14:59.983137 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab1474-941d-49eb-a96c-07ecd8587192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:14:59.983442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab1474-941d-49eb-a96c-07ecd8587192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:14:59.984788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab1474-941d-49eb-a96c-07ecd8587192 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:14:59.995777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 622/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:00.001142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fa190-6664-4187-a8d3-69aa1a53fed1 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:00.093917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fa190-6664-4187-a8d3-69aa1a53fed1 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:00.124910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d31f7-0a4c-4069-a388-1742d410ede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:00.125683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d31f7-0a4c-4069-a388-1742d410ede7 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:00.125964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d31f7-0a4c-4069-a388-1742d410ede7 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:00.126267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d31f7-0a4c-4069-a388-1742d410ede7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:00.133227 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d31f7-0a4c-4069-a388-1742d410ede7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:00.134686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d31f7-0a4c-4069-a388-1742d410ede7 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:00.148525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-168d31f7-0a4c-4069-a388-1742d410ede7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:15:00.149657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 649/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:15:00.155288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab1474-941d-49eb-a96c-07ecd8587192 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:00.248150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab1474-941d-49eb-a96c-07ecd8587192 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:00.279178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5e475-3402-4dfb-beda-7a55efd013d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:00.279819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5e475-3402-4dfb-beda-7a55efd013d8 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:00.280101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5e475-3402-4dfb-beda-7a55efd013d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:00.280402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5e475-3402-4dfb-beda-7a55efd013d8 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:00.281178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5e475-3402-4dfb-beda-7a55efd013d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:00.281486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5e475-3402-4dfb-beda-7a55efd013d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:00.282930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5e475-3402-4dfb-beda-7a55efd013d8 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:00.295236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 623/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:00.301241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d31f7-0a4c-4069-a388-1742d410ede7 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:00.394376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d31f7-0a4c-4069-a388-1742d410ede7 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:00.425750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d77039-82e6-4a35-89db-fdf9fac8bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:00.426657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d77039-82e6-4a35-89db-fdf9fac8bda1 None admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:00.426946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d77039-82e6-4a35-89db-fdf9fac8bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:00.427227 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d77039-82e6-4a35-89db-fdf9fac8bda1 None admin] PATH_INFO: `/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/a35ae873d42b490cae4dd610f2ac6a60/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:00.429153 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d77039-82e6-4a35-89db-fdf9fac8bda1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8f16a150f41d7a69e6506654256ce, user_id=a35ae873d42b490cae4dd610f2ac6a60, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:00.430612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d77039-82e6-4a35-89db-fdf9fac8bda1 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:00.443253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 650/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Mar 10 17:15:00 2022] PUT /identity/v3/projects/1eb8f16a150f41d7a69e6506654256ce/users/a35ae873d42b490cae4dd610f2ac6a60/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:15:02.708711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534cacf-732d-409a-914a-e3d00a2be5a4 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:02.709224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534cacf-732d-409a-914a-e3d00a2be5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:02.709224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534cacf-732d-409a-914a-e3d00a2be5a4 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:02.711022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 624/1274] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:15:02.716159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c941-965c-4a08-916b-620bf0225b8f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:02.716572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c941-965c-4a08-916b-620bf0225b8f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:02.716723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c941-965c-4a08-916b-620bf0225b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:02.733365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c2f4c941-965c-4a08-916b-620bf0225b8f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:15:02.734572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c2f4c941-965c-4a08-916b-620bf0225b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:15:02.796258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 651/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:15:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:15:02.820140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534cacf-732d-409a-914a-e3d00a2be5a4 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:02.918895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534cacf-732d-409a-914a-e3d00a2be5a4 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:02.950467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0325d16-13cb-4b1e-8bc0-2ed2985948d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:02.951246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0325d16-13cb-4b1e-8bc0-2ed2985948d0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:02.951530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0325d16-13cb-4b1e-8bc0-2ed2985948d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:02.951803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0325d16-13cb-4b1e-8bc0-2ed2985948d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:02.961418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0325d16-13cb-4b1e-8bc0-2ed2985948d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 17:15:02.968266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-a0325d16-13cb-4b1e-8bc0-2ed2985948d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 17:15:02.969429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 625/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Mar 10 17:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:15:02.976027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4c941-965c-4a08-916b-620bf0225b8f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:03.066856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4c941-965c-4a08-916b-620bf0225b8f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:03.098856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43259-852a-4840-a3dd-74fd3f9c9ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:03.099499 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43259-852a-4840-a3dd-74fd3f9c9ad8 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:03.099777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43259-852a-4840-a3dd-74fd3f9c9ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:03.100047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43259-852a-4840-a3dd-74fd3f9c9ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:03.100772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43259-852a-4840-a3dd-74fd3f9c9ad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:03.101073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43259-852a-4840-a3dd-74fd3f9c9ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:03.102430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43259-852a-4840-a3dd-74fd3f9c9ad8 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:03.109802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 652/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Mar 10 17:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:03.115315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0325d16-13cb-4b1e-8bc0-2ed2985948d0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:03.208876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0325d16-13cb-4b1e-8bc0-2ed2985948d0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:03.240002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd50a-a6e2-40d1-8852-272ea6702b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:03.240778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd50a-a6e2-40d1-8852-272ea6702b02 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:03.241064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd50a-a6e2-40d1-8852-272ea6702b02 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:03.241337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd50a-a6e2-40d1-8852-272ea6702b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:03.251393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd50a-a6e2-40d1-8852-272ea6702b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:03.252866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd50a-a6e2-40d1-8852-272ea6702b02 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:03.269018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-0c4dd50a-a6e2-40d1-8852-272ea6702b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:15:03.270167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 626/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:15:03.275703 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43259-852a-4840-a3dd-74fd3f9c9ad8 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:03.369358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43259-852a-4840-a3dd-74fd3f9c9ad8 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:03.401371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270712f-7dc3-43e3-94f0-81bcfa8fc936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:03.402026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270712f-7dc3-43e3-94f0-81bcfa8fc936 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:03.402345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270712f-7dc3-43e3-94f0-81bcfa8fc936 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:03.402628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270712f-7dc3-43e3-94f0-81bcfa8fc936 None admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:03.403342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270712f-7dc3-43e3-94f0-81bcfa8fc936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:03.403653 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270712f-7dc3-43e3-94f0-81bcfa8fc936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:03.405006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270712f-7dc3-43e3-94f0-81bcfa8fc936 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:03.416017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 653/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:03.421846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd50a-a6e2-40d1-8852-272ea6702b02 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:03.516037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd50a-a6e2-40d1-8852-272ea6702b02 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:03.547289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d02ad1-142f-4b1c-90c0-7cecae1c5081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:03.548072 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d02ad1-142f-4b1c-90c0-7cecae1c5081 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:03.548348 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d02ad1-142f-4b1c-90c0-7cecae1c5081 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:03.548616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d02ad1-142f-4b1c-90c0-7cecae1c5081 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:03.555529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d02ad1-142f-4b1c-90c0-7cecae1c5081 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:03.556938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d02ad1-142f-4b1c-90c0-7cecae1c5081 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:03.570322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-e6d02ad1-142f-4b1c-90c0-7cecae1c5081 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 17:15:03.571442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 627/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:15:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:15:03.577134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270712f-7dc3-43e3-94f0-81bcfa8fc936 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:03.669242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270712f-7dc3-43e3-94f0-81bcfa8fc936 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:03.700260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3095a3c-b057-46f2-9c86-b54c3d2fe007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:03.700910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095a3c-b057-46f2-9c86-b54c3d2fe007 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:03.701191 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095a3c-b057-46f2-9c86-b54c3d2fe007 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:03.701463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095a3c-b057-46f2-9c86-b54c3d2fe007 None admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:03.702299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095a3c-b057-46f2-9c86-b54c3d2fe007 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:03.702605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095a3c-b057-46f2-9c86-b54c3d2fe007 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:03.704008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095a3c-b057-46f2-9c86-b54c3d2fe007 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:03.720394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 654/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Mar 10 17:15:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:03.725841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d02ad1-142f-4b1c-90c0-7cecae1c5081 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:03.820071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d02ad1-142f-4b1c-90c0-7cecae1c5081 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:03.856543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82330443-0346-406a-b505-484067670ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:03.857173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330443-0346-406a-b505-484067670ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:03.857455 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330443-0346-406a-b505-484067670ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:03.857726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330443-0346-406a-b505-484067670ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:03.920058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82330443-0346-406a-b505-484067670ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:03.921496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82330443-0346-406a-b505-484067670ba4 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:04.012354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 628/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Mar 10 17:15:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 17:15:04.018112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3095a3c-b057-46f2-9c86-b54c3d2fe007 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:04.110586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3095a3c-b057-46f2-9c86-b54c3d2fe007 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:04.142983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15909e-e819-4d4a-a565-01137ac6021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:04.143774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15909e-e819-4d4a-a565-01137ac6021d None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:04.144057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15909e-e819-4d4a-a565-01137ac6021d None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:04.144329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15909e-e819-4d4a-a565-01137ac6021d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:04.154778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15909e-e819-4d4a-a565-01137ac6021d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:04.156207 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15909e-e819-4d4a-a565-01137ac6021d None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:04.173570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-7b15909e-e819-4d4a-a565-01137ac6021d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 17:15:04.175390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 655/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:15:04.180925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82330443-0346-406a-b505-484067670ba4 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:04.273468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82330443-0346-406a-b505-484067670ba4 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:04.306556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcd48b-3d6f-48a7-888d-fd99cd956cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:04.307209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcd48b-3d6f-48a7-888d-fd99cd956cc0 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:04.307492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcd48b-3d6f-48a7-888d-fd99cd956cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:04.307768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcd48b-3d6f-48a7-888d-fd99cd956cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:04.308481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcd48b-3d6f-48a7-888d-fd99cd956cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:04.308784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcd48b-3d6f-48a7-888d-fd99cd956cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:04.310159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcd48b-3d6f-48a7-888d-fd99cd956cc0 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:04.320871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 629/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Mar 10 17:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:04.326445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15909e-e819-4d4a-a565-01137ac6021d None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:04.419079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15909e-e819-4d4a-a565-01137ac6021d None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:04.450617 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd798ae-b9a9-40f6-b52b-94153ca6ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:04.451393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd798ae-b9a9-40f6-b52b-94153ca6ca81 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:04.451677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd798ae-b9a9-40f6-b52b-94153ca6ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:04.451953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd798ae-b9a9-40f6-b52b-94153ca6ca81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:04.458305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd798ae-b9a9-40f6-b52b-94153ca6ca81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:04.459720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd798ae-b9a9-40f6-b52b-94153ca6ca81 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:04.472710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING keystone.server.flask.application [None req-7dd798ae-b9a9-40f6-b52b-94153ca6ca81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 17:15:04.473825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 656/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Mar 10 17:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:15:04.479529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcd48b-3d6f-48a7-888d-fd99cd956cc0 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:04.572802 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcd48b-3d6f-48a7-888d-fd99cd956cc0 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:04.604929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e611d6e-e1df-44ca-bd42-be18438e8fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:04.605588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611d6e-e1df-44ca-bd42-be18438e8fa1 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:04.605872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611d6e-e1df-44ca-bd42-be18438e8fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:04.606175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611d6e-e1df-44ca-bd42-be18438e8fa1 None admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:04.606962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e611d6e-e1df-44ca-bd42-be18438e8fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:04.607273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e611d6e-e1df-44ca-bd42-be18438e8fa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:04.608704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e611d6e-e1df-44ca-bd42-be18438e8fa1 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:04.621111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 630/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Mar 10 17:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:04.627151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd798ae-b9a9-40f6-b52b-94153ca6ca81 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:04.722123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd798ae-b9a9-40f6-b52b-94153ca6ca81 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:04.752688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2969844-bd03-4923-a01f-f313a9646df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:04.753321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2969844-bd03-4923-a01f-f313a9646df2 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:04.753606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2969844-bd03-4923-a01f-f313a9646df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:04.753885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2969844-bd03-4923-a01f-f313a9646df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:04.754732 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2969844-bd03-4923-a01f-f313a9646df2 None admin] RBAC: Adding query filter params (role.id=d2d90e2ef72544ee8617f2b7789c6d78, scope.project.id=1eb8f16a150f41d7a69e6506654256ce, user.id=a35ae873d42b490cae4dd610f2ac6a60) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:04.755044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2969844-bd03-4923-a01f-f313a9646df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:04.756464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2969844-bd03-4923-a01f-f313a9646df2 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:04.761888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 657/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Mar 10 17:15:04 2022] GET /identity/v3/role_assignments?user.id=a35ae873d42b490cae4dd610f2ac6a60&scope.project.id=1eb8f16a150f41d7a69e6506654256ce&role.id=d2d90e2ef72544ee8617f2b7789c6d78 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:15:07.051933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71727898-7c3c-432c-88d1-d6a16527922e None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:07.052453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71727898-7c3c-432c-88d1-d6a16527922e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:07.052543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71727898-7c3c-432c-88d1-d6a16527922e None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:07.054258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 631/1288] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:15:07.059274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa1d9-eeaf-4281-8884-902277627911 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:07.059690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa1d9-eeaf-4281-8884-902277627911 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:07.059829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa1d9-eeaf-4281-8884-902277627911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:07.075958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-bd9fa1d9-eeaf-4281-8884-902277627911 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:15:07.077124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-bd9fa1d9-eeaf-4281-8884-902277627911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:15:07.138452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 658/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:15:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:15:07.160303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71727898-7c3c-432c-88d1-d6a16527922e None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:07.255293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71727898-7c3c-432c-88d1-d6a16527922e None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:07.286776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f37a46-f29b-41db-b616-98758232eb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:07.287553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f37a46-f29b-41db-b616-98758232eb19 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:07.287838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f37a46-f29b-41db-b616-98758232eb19 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:07.288120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f37a46-f29b-41db-b616-98758232eb19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:07.288767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f37a46-f29b-41db-b616-98758232eb19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:07.290164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f37a46-f29b-41db-b616-98758232eb19 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:07.301315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-d2f37a46-f29b-41db-b616-98758232eb19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 10 17:15:07.302566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 632/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:15:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:15:07.308413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa1d9-eeaf-4281-8884-902277627911 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:07.400680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa1d9-eeaf-4281-8884-902277627911 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:07.432119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48b6b5-cb95-4588-84f8-572e4c51bd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:07.432763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b6b5-cb95-4588-84f8-572e4c51bd9a None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:07.433047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b6b5-cb95-4588-84f8-572e4c51bd9a None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:07.433322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b6b5-cb95-4588-84f8-572e4c51bd9a None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:07.434012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b6b5-cb95-4588-84f8-572e4c51bd9a None admin] RBAC: Adding query filter params (name=placement) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:07.434351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b6b5-cb95-4588-84f8-572e4c51bd9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:07.435697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b6b5-cb95-4588-84f8-572e4c51bd9a None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:07.440255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 659/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Mar 10 17:15:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:15:07.446090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f37a46-f29b-41db-b616-98758232eb19 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:07.539663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f37a46-f29b-41db-b616-98758232eb19 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:07.571577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9cca7-42c8-44a4-be19-dd8288f32795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:07.572165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cca7-42c8-44a4-be19-dd8288f32795 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:07.572449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cca7-42c8-44a4-be19-dd8288f32795 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:07.572734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cca7-42c8-44a4-be19-dd8288f32795 None admin] PATH_INFO: `/v3/services` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:07.573419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9cca7-42c8-44a4-be19-dd8288f32795 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:07.573723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9cca7-42c8-44a4-be19-dd8288f32795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:07.575112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9cca7-42c8-44a4-be19-dd8288f32795 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:07.579266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 633/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Mar 10 17:15:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:09.832119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896fe41-6b57-4832-b09f-af86c2f8d575 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:09.832674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896fe41-6b57-4832-b09f-af86c2f8d575 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:09.832674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896fe41-6b57-4832-b09f-af86c2f8d575 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:09.834524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 660/1293] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:15:09.839879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d6046-b8a1-4517-9fcb-60bdc1bd4bd8 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:09.840451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d6046-b8a1-4517-9fcb-60bdc1bd4bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:09.840451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d6046-b8a1-4517-9fcb-60bdc1bd4bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:09.858466 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-465d6046-b8a1-4517-9fcb-60bdc1bd4bd8 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:15:09.859575 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-465d6046-b8a1-4517-9fcb-60bdc1bd4bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:15:09.924940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 634/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:15:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 17:15:09.948408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896fe41-6b57-4832-b09f-af86c2f8d575 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:10.043959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896fe41-6b57-4832-b09f-af86c2f8d575 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:10.074899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830c6ef-3e23-418b-a19a-3bc78bdbcc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:10.075550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830c6ef-3e23-418b-a19a-3bc78bdbcc12 None admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:10.075837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830c6ef-3e23-418b-a19a-3bc78bdbcc12 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:10.076117 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830c6ef-3e23-418b-a19a-3bc78bdbcc12 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:10.076833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830c6ef-3e23-418b-a19a-3bc78bdbcc12 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:10.078223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830c6ef-3e23-418b-a19a-3bc78bdbcc12 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:10.091463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 661/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Mar 10 17:15:09 2022] POST /identity/v3/services => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:15:12.379255 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee018-c734-48c4-9452-c36e65b9bf88 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:12.379733 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee018-c734-48c4-9452-c36e65b9bf88 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:12.379835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee018-c734-48c4-9452-c36e65b9bf88 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:12.381581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 635/1296] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:15:12.386739 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf515-3a7c-4147-b293-54aef9254ccd None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:12.387160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf515-3a7c-4147-b293-54aef9254ccd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:12.387301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf515-3a7c-4147-b293-54aef9254ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:12.404052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-abcbf515-3a7c-4147-b293-54aef9254ccd None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:15:12.405207 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-abcbf515-3a7c-4147-b293-54aef9254ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:15:12.471798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 662/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:15:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:15:12.493671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee018-c734-48c4-9452-c36e65b9bf88 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:12.589436 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee018-c734-48c4-9452-c36e65b9bf88 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:12.620366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0b23b-5b3e-4b5f-a11e-46089a411d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:12.621135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0b23b-5b3e-4b5f-a11e-46089a411d08 None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:12.621414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0b23b-5b3e-4b5f-a11e-46089a411d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:12.621683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0b23b-5b3e-4b5f-a11e-46089a411d08 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:12.622349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0b23b-5b3e-4b5f-a11e-46089a411d08 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:12.623695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0b23b-5b3e-4b5f-a11e-46089a411d08 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:12.634773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-a8f0b23b-5b3e-4b5f-a11e-46089a411d08 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 10 17:15:12.635884 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 636/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:15:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:15:12.641686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbf515-3a7c-4147-b293-54aef9254ccd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:12.733901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbf515-3a7c-4147-b293-54aef9254ccd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:12.766010 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df9376-d47a-416a-a051-16b567d1a085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:12.766692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df9376-d47a-416a-a051-16b567d1a085 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:12.766980 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df9376-d47a-416a-a051-16b567d1a085 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:12.767262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df9376-d47a-416a-a051-16b567d1a085 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:12.767959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df9376-d47a-416a-a051-16b567d1a085 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:12.768273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df9376-d47a-416a-a051-16b567d1a085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:12.769658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df9376-d47a-416a-a051-16b567d1a085 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:12.774514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 663/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Mar 10 17:15:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:12.780205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0b23b-5b3e-4b5f-a11e-46089a411d08 None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:12.878876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0b23b-5b3e-4b5f-a11e-46089a411d08 None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:12.909747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd29c6-54d2-4d38-9052-109f9e62f40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:12.910424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd29c6-54d2-4d38-9052-109f9e62f40e None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:12.910713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd29c6-54d2-4d38-9052-109f9e62f40e None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:12.910994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd29c6-54d2-4d38-9052-109f9e62f40e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:12.911773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd29c6-54d2-4d38-9052-109f9e62f40e None admin] RBAC: Adding query filter params (interface=public, service_id=85058dc3fff5412aa0f56091fad687bc, region_id=RegionOne) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:12.912085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd29c6-54d2-4d38-9052-109f9e62f40e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:12.913441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd29c6-54d2-4d38-9052-109f9e62f40e None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:12.918517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 637/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Mar 10 17:15:12 2022] GET /identity/v3/endpoints?service_id=85058dc3fff5412aa0f56091fad687bc&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:12.924062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df9376-d47a-416a-a051-16b567d1a085 None admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:13.018174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df9376-d47a-416a-a051-16b567d1a085 None admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:13.050440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23575a-6bcd-43ac-a278-57d93b78b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:13.051097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23575a-6bcd-43ac-a278-57d93b78b400 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:13.051384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23575a-6bcd-43ac-a278-57d93b78b400 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:13.051664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23575a-6bcd-43ac-a278-57d93b78b400 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:13.052337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23575a-6bcd-43ac-a278-57d93b78b400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:13.053688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23575a-6bcd-43ac-a278-57d93b78b400 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:13.060162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 664/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Mar 10 17:15:12 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:15:15.339681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d19fcb-a770-4843-86ed-28d72ecfd369 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:15.340129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d19fcb-a770-4843-86ed-28d72ecfd369 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:15.340219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d19fcb-a770-4843-86ed-28d72ecfd369 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:15.342005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 638/1302] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:15:15.347808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc6f85-2805-438e-bd71-698b3d2a2ef1 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:15.348182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc6f85-2805-438e-bd71-698b3d2a2ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:15.348346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc6f85-2805-438e-bd71-698b3d2a2ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:15.364458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9bcc6f85-2805-438e-bd71-698b3d2a2ef1 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:15:15.365637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9bcc6f85-2805-438e-bd71-698b3d2a2ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:15:15.426784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 665/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:15:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 17:15:15.449709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d19fcb-a770-4843-86ed-28d72ecfd369 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:15.545490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d19fcb-a770-4843-86ed-28d72ecfd369 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:15.577032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77487dfe-903a-49b4-afb7-def42db2528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:15.577758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77487dfe-903a-49b4-afb7-def42db2528d None admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:15.578041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77487dfe-903a-49b4-afb7-def42db2528d None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:15.578347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77487dfe-903a-49b4-afb7-def42db2528d None admin] PATH_INFO: `/v3/services/placement` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:15.578992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77487dfe-903a-49b4-afb7-def42db2528d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:15.580343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77487dfe-903a-49b4-afb7-def42db2528d None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:15.591606 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING keystone.server.flask.application [None req-77487dfe-903a-49b4-afb7-def42db2528d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 10 17:15:15.592728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 639/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Mar 10 17:15:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 17:15:15.598409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc6f85-2805-438e-bd71-698b3d2a2ef1 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:15.690554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc6f85-2805-438e-bd71-698b3d2a2ef1 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:15.721316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1213779-c493-45a3-a3c4-65dba14659a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:15.722485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1213779-c493-45a3-a3c4-65dba14659a9 None admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:15.722766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1213779-c493-45a3-a3c4-65dba14659a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:15.723040 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1213779-c493-45a3-a3c4-65dba14659a9 None admin] PATH_INFO: `/v3/services` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:15.723727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1213779-c493-45a3-a3c4-65dba14659a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:15:15.724032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1213779-c493-45a3-a3c4-65dba14659a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:15.725366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1213779-c493-45a3-a3c4-65dba14659a9 None admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:15.730087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 666/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Mar 10 17:15:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:15:15.735628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77487dfe-903a-49b4-afb7-def42db2528d None admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:15:15.829105 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77487dfe-903a-49b4-afb7-def42db2528d None admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:15:15.860639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec7073-3a25-44a5-96b9-fade36583883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:15:15.861271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7073-3a25-44a5-96b9-fade36583883 None admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:15:15.861558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7073-3a25-44a5-96b9-fade36583883 None admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:15:15.861836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7073-3a25-44a5-96b9-fade36583883 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:15:15.862613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec7073-3a25-44a5-96b9-fade36583883 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:15:15.863953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec7073-3a25-44a5-96b9-fade36583883 None admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:15:15.880899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 640/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Mar 10 17:15:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:16:19.551545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798edb7-830b-4800-ad7a-521dbeae8dbd None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:19.552496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798edb7-830b-4800-ad7a-521dbeae8dbd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:19.552929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798edb7-830b-4800-ad7a-521dbeae8dbd None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:19.560308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bccb1-dd56-4b62-9e77-a6354a013f84 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:19.561164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bccb1-dd56-4b62-9e77-a6354a013f84 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:19.561596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bccb1-dd56-4b62-9e77-a6354a013f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:19.565746 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 667/1307] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:19.645637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-7f1bccb1-dd56-4b62-9e77-a6354a013f84 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:19.648523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7f1bccb1-dd56-4b62-9e77-a6354a013f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:19.798511 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 641/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:16:19.808432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798edb7-830b-4800-ad7a-521dbeae8dbd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:19.810205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7798edb7-830b-4800-ad7a-521dbeae8dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:19.983673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798edb7-830b-4800-ad7a-521dbeae8dbd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:20.080622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47632f-799a-43b7-9cf0-000e87634d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:20.081241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47632f-799a-43b7-9cf0-000e87634d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:20.081524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47632f-799a-43b7-9cf0-000e87634d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:20.081799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47632f-799a-43b7-9cf0-000e87634d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:20.082583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47632f-799a-43b7-9cf0-000e87634d7c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:20.084308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING py.warnings [None req-7b47632f-799a-43b7-9cf0-000e87634d7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:16:20.084308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: warnings.warn(msg) Mar 10 17:16:20.084308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: Mar 10 17:16:20.085467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47632f-799a-43b7-9cf0-000e87634d7c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:20.104131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 668/1309] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:16:19 2022] GET /identity/v3/projects => generated 2553 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:16:22.453502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8090bbc-f48d-43f1-b203-8a32e145890c None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:22.454021 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8090bbc-f48d-43f1-b203-8a32e145890c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:22.454126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8090bbc-f48d-43f1-b203-8a32e145890c None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:22.455879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 642/1310] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:22.460944 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce21e4-0f88-4016-978b-9dd59922a546 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:22.461353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce21e4-0f88-4016-978b-9dd59922a546 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:22.461516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce21e4-0f88-4016-978b-9dd59922a546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:22.539627 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-25ce21e4-0f88-4016-978b-9dd59922a546 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:22.541081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-25ce21e4-0f88-4016-978b-9dd59922a546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:22.631219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 669/1311] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:16:22.683558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34915-1017-4aa3-8c9e-0ffbf0dc29b8 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:22.683857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34915-1017-4aa3-8c9e-0ffbf0dc29b8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:22.684144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34915-1017-4aa3-8c9e-0ffbf0dc29b8 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:22.685916 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 643/1312] 10.222.0.16 () {54 vars in 962 bytes} [Thu Mar 10 17:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:22.697328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad71f5-e935-47eb-9689-ef5a0e5d3005 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:22.697705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad71f5-e935-47eb-9689-ef5a0e5d3005 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:22.697987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad71f5-e935-47eb-9689-ef5a0e5d3005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:22.773630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-92ad71f5-e935-47eb-9689-ef5a0e5d3005 None None] MFA Rules not processed for user `701c0e43cc30442582456f4f7153333a`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:22.774868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-92ad71f5-e935-47eb-9689-ef5a0e5d3005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:22.855195 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 670/1313] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Mar 10 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:16:22.864337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34915-1017-4aa3-8c9e-0ffbf0dc29b8 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:22.865843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f6a34915-1017-4aa3-8c9e-0ffbf0dc29b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:22.971431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34915-1017-4aa3-8c9e-0ffbf0dc29b8 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:23.042496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6817a1-9604-4e5f-9caa-eb46285e7f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:23.043249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6817a1-9604-4e5f-9caa-eb46285e7f0c service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:23.043544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6817a1-9604-4e5f-9caa-eb46285e7f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:23.043839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6817a1-9604-4e5f-9caa-eb46285e7f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:23.045434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-aa6817a1-9604-4e5f-9caa-eb46285e7f0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:23.149895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6817a1-9604-4e5f-9caa-eb46285e7f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:23.151281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6817a1-9604-4e5f-9caa-eb46285e7f0c service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:23.169174 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 644/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:25.769538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee8eec-6d22-43d8-a372-f93cb635f2f4 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:25.770556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee8eec-6d22-43d8-a372-f93cb635f2f4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:25.770848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee8eec-6d22-43d8-a372-f93cb635f2f4 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:25.772959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 671/1315] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:25.778907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197f2c3-5b49-445d-8beb-0ff4d626b770 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:25.779437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197f2c3-5b49-445d-8beb-0ff4d626b770 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:25.779608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197f2c3-5b49-445d-8beb-0ff4d626b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:25.850710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3197f2c3-5b49-445d-8beb-0ff4d626b770 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:25.851920 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3197f2c3-5b49-445d-8beb-0ff4d626b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:25.952493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 645/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:25.991550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee8eec-6d22-43d8-a372-f93cb635f2f4 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:25.993051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-46ee8eec-6d22-43d8-a372-f93cb635f2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:26.094069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee8eec-6d22-43d8-a372-f93cb635f2f4 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:26.164835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d725d-8aaf-4d74-bd4b-3a3b99b2f0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:26.165736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d725d-8aaf-4d74-bd4b-3a3b99b2f0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:26.166016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d725d-8aaf-4d74-bd4b-3a3b99b2f0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:26.166316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d725d-8aaf-4d74-bd4b-3a3b99b2f0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:26.167931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1e3d725d-8aaf-4d74-bd4b-3a3b99b2f0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:26.270498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d725d-8aaf-4d74-bd4b-3a3b99b2f0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:26.271842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d725d-8aaf-4d74-bd4b-3a3b99b2f0e2 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:26.289646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 672/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:28.896344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea79e5-6ac6-4f5b-b8f7-34f79a1c93a2 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:28.896872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea79e5-6ac6-4f5b-b8f7-34f79a1c93a2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:28.896872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea79e5-6ac6-4f5b-b8f7-34f79a1c93a2 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:28.898700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 646/1318] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:28.903812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1cb7-b119-4205-9fc4-7ce65940d502 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:28.904224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1cb7-b119-4205-9fc4-7ce65940d502 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:28.904365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1cb7-b119-4205-9fc4-7ce65940d502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:28.966143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a87d1cb7-b119-4205-9fc4-7ce65940d502 None None] MFA Rules not processed for user `62c6a5f644564d4ea81a8a00bc3dc990`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:28.967338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a87d1cb7-b119-4205-9fc4-7ce65940d502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:29.057470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 673/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:29.097686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea79e5-6ac6-4f5b-b8f7-34f79a1c93a2 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:29.099231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7bea79e5-6ac6-4f5b-b8f7-34f79a1c93a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:29.196822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea79e5-6ac6-4f5b-b8f7-34f79a1c93a2 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:29.266827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af9927-dcd2-4b9f-bc15-067962e020aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:29.267483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af9927-dcd2-4b9f-bc15-067962e020aa service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:29.267744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af9927-dcd2-4b9f-bc15-067962e020aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:29.268021 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af9927-dcd2-4b9f-bc15-067962e020aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:29.269625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d2af9927-dcd2-4b9f-bc15-067962e020aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:29.373079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af9927-dcd2-4b9f-bc15-067962e020aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:29.374554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af9927-dcd2-4b9f-bc15-067962e020aa service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:29.392510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 647/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:32.191450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6eaa7-f3a2-42f4-8729-f9d56838d76a None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:32.192011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6eaa7-f3a2-42f4-8729-f9d56838d76a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:32.192011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6eaa7-f3a2-42f4-8729-f9d56838d76a None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:32.193770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 674/1321] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:32.199281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cec4b-1fce-44d4-b09a-4897496e4efb None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:32.199700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cec4b-1fce-44d4-b09a-4897496e4efb None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:32.199843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cec4b-1fce-44d4-b09a-4897496e4efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:32.262460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-726cec4b-1fce-44d4-b09a-4897496e4efb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:32.263694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-726cec4b-1fce-44d4-b09a-4897496e4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:32.356325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 648/1322] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:32.408576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034170aa-fbac-42ba-a82b-ef5c91949533 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:32.408872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034170aa-fbac-42ba-a82b-ef5c91949533 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:32.409156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034170aa-fbac-42ba-a82b-ef5c91949533 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:32.410999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 675/1323] 10.222.0.16 () {54 vars in 962 bytes} [Thu Mar 10 17:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:32.416996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d01f-306f-46e4-9db4-00bbf95d7ebc None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:32.417285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d01f-306f-46e4-9db4-00bbf95d7ebc None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:32.417560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d01f-306f-46e4-9db4-00bbf95d7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:32.487472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-8b45d01f-306f-46e4-9db4-00bbf95d7ebc None None] MFA Rules not processed for user `701c0e43cc30442582456f4f7153333a`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:32.488640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8b45d01f-306f-46e4-9db4-00bbf95d7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:32.558941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 649/1324] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Mar 10 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:32.567982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034170aa-fbac-42ba-a82b-ef5c91949533 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:32.569451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-034170aa-fbac-42ba-a82b-ef5c91949533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:32.666635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034170aa-fbac-42ba-a82b-ef5c91949533 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:32.735372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284bb22-855e-48de-ba50-840b102d6755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:32.736008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284bb22-855e-48de-ba50-840b102d6755 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:32.736288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284bb22-855e-48de-ba50-840b102d6755 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:32.736558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284bb22-855e-48de-ba50-840b102d6755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:32.738258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2284bb22-855e-48de-ba50-840b102d6755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:32.839497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284bb22-855e-48de-ba50-840b102d6755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:32.840896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284bb22-855e-48de-ba50-840b102d6755 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:32.857808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 676/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:36.229038 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f72d2-37b1-4822-96c2-3fb5d2e248c8 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:36.229568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f72d2-37b1-4822-96c2-3fb5d2e248c8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:36.229692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f72d2-37b1-4822-96c2-3fb5d2e248c8 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:36.231499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 650/1326] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:36.237175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed0c0a-f612-4c2a-8e3f-80b0ff1235e3 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:36.237572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed0c0a-f612-4c2a-8e3f-80b0ff1235e3 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:36.237796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed0c0a-f612-4c2a-8e3f-80b0ff1235e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:36.305328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e1ed0c0a-f612-4c2a-8e3f-80b0ff1235e3 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:36.306823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e1ed0c0a-f612-4c2a-8e3f-80b0ff1235e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:36.398897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 677/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:36.435607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f72d2-37b1-4822-96c2-3fb5d2e248c8 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:36.437130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-205f72d2-37b1-4822-96c2-3fb5d2e248c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:36.536388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f72d2-37b1-4822-96c2-3fb5d2e248c8 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:36.608693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaca1cf-d829-4c80-b65e-251a0fcbc708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:36.609955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaca1cf-d829-4c80-b65e-251a0fcbc708 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:36.610268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaca1cf-d829-4c80-b65e-251a0fcbc708 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:36.610545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaca1cf-d829-4c80-b65e-251a0fcbc708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:36.612145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-aeaca1cf-d829-4c80-b65e-251a0fcbc708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:36.713461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaca1cf-d829-4c80-b65e-251a0fcbc708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:36.714919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaca1cf-d829-4c80-b65e-251a0fcbc708 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:36.732331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 651/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:39.095952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a892-bd68-47dc-a157-93aaec1cacd6 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:39.096507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a892-bd68-47dc-a157-93aaec1cacd6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:39.096507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a892-bd68-47dc-a157-93aaec1cacd6 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:39.098460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 678/1329] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:39.103416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06daa-02c4-47cb-a6ff-b6b844eda081 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:39.103802 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06daa-02c4-47cb-a6ff-b6b844eda081 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:39.103980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06daa-02c4-47cb-a6ff-b6b844eda081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:39.167137 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-61c06daa-02c4-47cb-a6ff-b6b844eda081 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:39.168319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-61c06daa-02c4-47cb-a6ff-b6b844eda081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:39.262260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 652/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:39.300266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a892-bd68-47dc-a157-93aaec1cacd6 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:39.304468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-91e3a892-bd68-47dc-a157-93aaec1cacd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:39.404039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a892-bd68-47dc-a157-93aaec1cacd6 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:39.472695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baccb2e-ce24-48b1-aa35-07832941b63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:39.473411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baccb2e-ce24-48b1-aa35-07832941b63b service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:39.473609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baccb2e-ce24-48b1-aa35-07832941b63b service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:39.473882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baccb2e-ce24-48b1-aa35-07832941b63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:39.475528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4baccb2e-ce24-48b1-aa35-07832941b63b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:39.581125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baccb2e-ce24-48b1-aa35-07832941b63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:39.582582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baccb2e-ce24-48b1-aa35-07832941b63b service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:39.599564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 679/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:41.971574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627807e-df47-4246-b8f2-9fead9180264 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:41.972132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627807e-df47-4246-b8f2-9fead9180264 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:41.972132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627807e-df47-4246-b8f2-9fead9180264 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:41.973985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 653/1332] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:41.979257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6030a-e4cb-401c-bc78-757eba5dcf52 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:41.979646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6030a-e4cb-401c-bc78-757eba5dcf52 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:41.979856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6030a-e4cb-401c-bc78-757eba5dcf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:42.042843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-63a6030a-e4cb-401c-bc78-757eba5dcf52 None None] MFA Rules not processed for user `62c6a5f644564d4ea81a8a00bc3dc990`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:42.044022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-63a6030a-e4cb-401c-bc78-757eba5dcf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:42.136324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 680/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:42.174261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627807e-df47-4246-b8f2-9fead9180264 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:42.175769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2627807e-df47-4246-b8f2-9fead9180264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:42.273771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627807e-df47-4246-b8f2-9fead9180264 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:42.345239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f6341-aba0-4982-ab12-f84c0cdf4664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:42.345888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f6341-aba0-4982-ab12-f84c0cdf4664 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:42.346205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f6341-aba0-4982-ab12-f84c0cdf4664 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:42.346487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f6341-aba0-4982-ab12-f84c0cdf4664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:42.348121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-4f6f6341-aba0-4982-ab12-f84c0cdf4664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:42.453111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f6341-aba0-4982-ab12-f84c0cdf4664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:42.454592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f6341-aba0-4982-ab12-f84c0cdf4664 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:42.471738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 654/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:44.997497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7482d8-23da-4f25-8175-ec9db199728d None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:44.998018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7482d8-23da-4f25-8175-ec9db199728d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:44.998163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7482d8-23da-4f25-8175-ec9db199728d None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:44.999876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 681/1335] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:45.006068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ab23-19ce-43b9-87da-2358362079e0 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:45.006558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ab23-19ce-43b9-87da-2358362079e0 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:45.006727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ab23-19ce-43b9-87da-2358362079e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:45.076931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a925ab23-19ce-43b9-87da-2358362079e0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:45.078583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a925ab23-19ce-43b9-87da-2358362079e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:45.170599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 655/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:45.206021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7482d8-23da-4f25-8175-ec9db199728d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:45.207549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ab7482d8-23da-4f25-8175-ec9db199728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:45.307151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7482d8-23da-4f25-8175-ec9db199728d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:45.381456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e06278-dee9-4300-b6e5-f8d0fff8d935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:45.382125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06278-dee9-4300-b6e5-f8d0fff8d935 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:45.382427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06278-dee9-4300-b6e5-f8d0fff8d935 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:45.382702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06278-dee9-4300-b6e5-f8d0fff8d935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:45.384371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-02e06278-dee9-4300-b6e5-f8d0fff8d935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:45.495691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e06278-dee9-4300-b6e5-f8d0fff8d935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:45.497147 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e06278-dee9-4300-b6e5-f8d0fff8d935 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:45.518318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 682/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:47.868417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30f052-1b64-4eec-84b1-c646fc078342 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:47.868939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30f052-1b64-4eec-84b1-c646fc078342 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:47.868939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30f052-1b64-4eec-84b1-c646fc078342 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:47.870691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 656/1338] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:47.876275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22b9f5-843e-4b0e-b1cd-acf8dd9c818b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:47.876648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22b9f5-843e-4b0e-b1cd-acf8dd9c818b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:47.876836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22b9f5-843e-4b0e-b1cd-acf8dd9c818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:47.940007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-bc22b9f5-843e-4b0e-b1cd-acf8dd9c818b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:47.941190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-bc22b9f5-843e-4b0e-b1cd-acf8dd9c818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:48.037501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 683/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:48.077937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30f052-1b64-4eec-84b1-c646fc078342 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:48.079470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3a30f052-1b64-4eec-84b1-c646fc078342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:48.177460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30f052-1b64-4eec-84b1-c646fc078342 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:48.245344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec589829-6811-4aab-98e6-8eb7669f1a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:48.245977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589829-6811-4aab-98e6-8eb7669f1a19 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:48.246287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589829-6811-4aab-98e6-8eb7669f1a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:48.246564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589829-6811-4aab-98e6-8eb7669f1a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:48.248148 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ec589829-6811-4aab-98e6-8eb7669f1a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:48.351244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589829-6811-4aab-98e6-8eb7669f1a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:48.352666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589829-6811-4aab-98e6-8eb7669f1a19 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:48.370469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 657/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:50.968909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe0282-10fc-44a2-972a-8fa0b891a5a6 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:50.969503 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe0282-10fc-44a2-972a-8fa0b891a5a6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:50.969503 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe0282-10fc-44a2-972a-8fa0b891a5a6 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:50.971275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 684/1341] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:50.976716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214a37-f2ff-4507-906b-966dc79cc7ef None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:50.977139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214a37-f2ff-4507-906b-966dc79cc7ef None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:50.977269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214a37-f2ff-4507-906b-966dc79cc7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:51.045335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-47214a37-f2ff-4507-906b-966dc79cc7ef None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:51.046582 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-47214a37-f2ff-4507-906b-966dc79cc7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:51.144842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 658/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:51.181301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe0282-10fc-44a2-972a-8fa0b891a5a6 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:51.183447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2fbe0282-10fc-44a2-972a-8fa0b891a5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:51.275553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe0282-10fc-44a2-972a-8fa0b891a5a6 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:51.279373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab60062-4d66-47ba-92c4-936be3994aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:51.280070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab60062-4d66-47ba-92c4-936be3994aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:51.280263 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab60062-4d66-47ba-92c4-936be3994aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:51.280539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab60062-4d66-47ba-92c4-936be3994aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:51.289833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab60062-4d66-47ba-92c4-936be3994aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:51.291463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab60062-4d66-47ba-92c4-936be3994aa0 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:51.301389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 685/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:55.581408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eafb2-1cdd-4283-a3b3-432ae96f6ac0 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:55.581900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eafb2-1cdd-4283-a3b3-432ae96f6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:55.581900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eafb2-1cdd-4283-a3b3-432ae96f6ac0 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:55.583779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 659/1344] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:55.588987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205be39-bf75-43c7-8815-afa61737c2d4 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:55.589427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205be39-bf75-43c7-8815-afa61737c2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:55.589523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205be39-bf75-43c7-8815-afa61737c2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:55.618346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e205be39-bf75-43c7-8815-afa61737c2d4 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:55.619534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e205be39-bf75-43c7-8815-afa61737c2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:55.692351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 686/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:55.729930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eafb2-1cdd-4283-a3b3-432ae96f6ac0 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:55.740913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eafb2-1cdd-4283-a3b3-432ae96f6ac0 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:55.744294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ab52a-e00c-4c4e-b604-a62b24c51818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:55.744919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ab52a-e00c-4c4e-b604-a62b24c51818 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:55.745199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ab52a-e00c-4c4e-b604-a62b24c51818 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:55.745471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ab52a-e00c-4c4e-b604-a62b24c51818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:55.754935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ab52a-e00c-4c4e-b604-a62b24c51818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:55.756377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ab52a-e00c-4c4e-b604-a62b24c51818 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:55.765909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 660/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:16:58.654695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88ea46-7cd0-49d1-bdf6-cffba9ea83aa None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:58.655222 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88ea46-7cd0-49d1-bdf6-cffba9ea83aa None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:58.655309 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88ea46-7cd0-49d1-bdf6-cffba9ea83aa None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:58.657063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 687/1347] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:16:58.662190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b1f56-82a6-465b-b6a5-291635d8816a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:58.662745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b1f56-82a6-465b-b6a5-291635d8816a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:58.662842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b1f56-82a6-465b-b6a5-291635d8816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:58.680966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-0b2b1f56-82a6-465b-b6a5-291635d8816a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:16:58.682201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0b2b1f56-82a6-465b-b6a5-291635d8816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:16:58.690679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 661/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:16:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:16:58.727212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88ea46-7cd0-49d1-bdf6-cffba9ea83aa None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:16:58.743786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88ea46-7cd0-49d1-bdf6-cffba9ea83aa None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:16:58.751308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d21eb-ff24-4119-b449-2dc811f1ad24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:16:58.751960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d21eb-ff24-4119-b449-2dc811f1ad24 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:16:58.752246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d21eb-ff24-4119-b449-2dc811f1ad24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:16:58.752523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d21eb-ff24-4119-b449-2dc811f1ad24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:16:58.761676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d21eb-ff24-4119-b449-2dc811f1ad24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:16:58.763126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d21eb-ff24-4119-b449-2dc811f1ad24 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:16:58.772445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 688/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:16:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:03.146452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff88d-c21d-4cd1-b1db-cbc11ad88239 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:03.146973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff88d-c21d-4cd1-b1db-cbc11ad88239 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:03.147096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff88d-c21d-4cd1-b1db-cbc11ad88239 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:03.148787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 662/1350] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:03.153871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d70bed-33ca-4017-9dc9-4883d0e76df6 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:03.154324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d70bed-33ca-4017-9dc9-4883d0e76df6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:03.154463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d70bed-33ca-4017-9dc9-4883d0e76df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:03.172787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-13d70bed-33ca-4017-9dc9-4883d0e76df6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:03.173895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-13d70bed-33ca-4017-9dc9-4883d0e76df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:03.181605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 689/1351] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:17:03.219173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff88d-c21d-4cd1-b1db-cbc11ad88239 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:03.229764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff88d-c21d-4cd1-b1db-cbc11ad88239 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:03.234029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a443a-239b-468b-a35a-457691fe7386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:03.234740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a443a-239b-468b-a35a-457691fe7386 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:03.235027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a443a-239b-468b-a35a-457691fe7386 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:03.235306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a443a-239b-468b-a35a-457691fe7386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:03.244146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a443a-239b-468b-a35a-457691fe7386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:03.245573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a443a-239b-468b-a35a-457691fe7386 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:03.255352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 663/1352] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:08.681833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd26e4-5b2f-4085-a9bc-659391719dd2 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:08.682831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd26e4-5b2f-4085-a9bc-659391719dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:08.683363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd26e4-5b2f-4085-a9bc-659391719dd2 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:08.695931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 690/1353] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:17:08 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:08.705376 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330c25-e2e1-4fc5-a008-160f8d30705c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:08.706612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330c25-e2e1-4fc5-a008-160f8d30705c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:08.706904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330c25-e2e1-4fc5-a008-160f8d30705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:08.836267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-09330c25-e2e1-4fc5-a008-160f8d30705c None None] MFA Rules not processed for user `a35ae873d42b490cae4dd610f2ac6a60`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:08.837849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-09330c25-e2e1-4fc5-a008-160f8d30705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:08.917555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 664/1354] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:17:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:13.438562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d59047-71c9-482d-ac77-2d1d5afadda3 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:13.439061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d59047-71c9-482d-ac77-2d1d5afadda3 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:13.439171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d59047-71c9-482d-ac77-2d1d5afadda3 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:13.441030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 691/1355] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:13.445708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212341a1-c815-4f78-8445-2d8366bf2095 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:13.446123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212341a1-c815-4f78-8445-2d8366bf2095 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:13.446347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212341a1-c815-4f78-8445-2d8366bf2095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:13.464277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-212341a1-c815-4f78-8445-2d8366bf2095 None None] MFA Rules not processed for user `a35ae873d42b490cae4dd610f2ac6a60`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:13.465460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-212341a1-c815-4f78-8445-2d8366bf2095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:13.474668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 665/1356] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:17:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:17:14.940599 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295cd9f-aeb0-42ce-9716-dbf10aa1f3f6 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:14.941138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295cd9f-aeb0-42ce-9716-dbf10aa1f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:14.941138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295cd9f-aeb0-42ce-9716-dbf10aa1f3f6 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:14.943084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 692/1357] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:14.948351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528336-0a84-48f1-ab87-c0a5f7138fee None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:14.948753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528336-0a84-48f1-ab87-c0a5f7138fee None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:14.948937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528336-0a84-48f1-ab87-c0a5f7138fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:14.967644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-75528336-0a84-48f1-ab87-c0a5f7138fee None None] MFA Rules not processed for user `a35ae873d42b490cae4dd610f2ac6a60`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:14.968945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-75528336-0a84-48f1-ab87-c0a5f7138fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:14.977465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 666/1358] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:17:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:18.750504 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024af02b-526f-4102-910e-f343a5ee7f24 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:18.751049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024af02b-526f-4102-910e-f343a5ee7f24 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:18.751049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024af02b-526f-4102-910e-f343a5ee7f24 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:18.753049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 693/1359] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:18.758193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd4e3-397b-4e6b-8c02-e23b681a590a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:18.758649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd4e3-397b-4e6b-8c02-e23b681a590a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:18.758758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd4e3-397b-4e6b-8c02-e23b681a590a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:18.778554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1effd4e3-397b-4e6b-8c02-e23b681a590a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:18.780530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1effd4e3-397b-4e6b-8c02-e23b681a590a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:18.798275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 667/1360] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:18.838675 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b60b0-459c-412d-9e82-cc3b6bba3161 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:18.838962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b60b0-459c-412d-9e82-cc3b6bba3161 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:18.839264 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b60b0-459c-412d-9e82-cc3b6bba3161 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:18.841439 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 694/1361] 10.222.0.16 () {54 vars in 961 bytes} [Thu Mar 10 17:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:18.847431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ef10-bb74-4f56-b9f3-a3f8ee3b8a92 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:18.847753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ef10-bb74-4f56-b9f3-a3f8ee3b8a92 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:18.848181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ef10-bb74-4f56-b9f3-a3f8ee3b8a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:18.896490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-df20ef10-bb74-4f56-b9f3-a3f8ee3b8a92 None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:18.897867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-df20ef10-bb74-4f56-b9f3-a3f8ee3b8a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:18.986335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 668/1362] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Mar 10 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:17:18.994379 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b60b0-459c-412d-9e82-cc3b6bba3161 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:19.008319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b60b0-459c-412d-9e82-cc3b6bba3161 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:19.014382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be467e-4383-4016-8427-b1bab0bcc4d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:19.015021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be467e-4383-4016-8427-b1bab0bcc4d4 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:19.015302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be467e-4383-4016-8427-b1bab0bcc4d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:19.015584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be467e-4383-4016-8427-b1bab0bcc4d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:19.023645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be467e-4383-4016-8427-b1bab0bcc4d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:19.025192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be467e-4383-4016-8427-b1bab0bcc4d4 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:19.035579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 695/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:21.585681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772297f-e46b-4d12-a690-6e1064979132 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:21.586275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772297f-e46b-4d12-a690-6e1064979132 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:21.586275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772297f-e46b-4d12-a690-6e1064979132 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:21.588367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 669/1364] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:21.594640 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ef437-0908-4b61-bb93-4877895ef076 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:21.595101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ef437-0908-4b61-bb93-4877895ef076 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:21.595188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ef437-0908-4b61-bb93-4877895ef076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:21.616047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-973ef437-0908-4b61-bb93-4877895ef076 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:21.617237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-973ef437-0908-4b61-bb93-4877895ef076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:21.625118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 696/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:21.669801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772297f-e46b-4d12-a690-6e1064979132 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:21.684465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772297f-e46b-4d12-a690-6e1064979132 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:21.690030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43caf3-eb31-4482-9d8e-3d5f833bf42a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:21.690705 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43caf3-eb31-4482-9d8e-3d5f833bf42a service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:21.690985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43caf3-eb31-4482-9d8e-3d5f833bf42a service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:21.691256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43caf3-eb31-4482-9d8e-3d5f833bf42a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:21.699697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43caf3-eb31-4482-9d8e-3d5f833bf42a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:21.701312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43caf3-eb31-4482-9d8e-3d5f833bf42a service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:21.711569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 670/1366] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:17:24.321980 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f688-7a86-4f90-90d9-2cdcbfebc92e None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:24.322536 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f688-7a86-4f90-90d9-2cdcbfebc92e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:24.322619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f688-7a86-4f90-90d9-2cdcbfebc92e None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:24.324335 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 697/1367] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:24.330042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cd170-73bf-4101-a5cd-9bf047b47312 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:24.330487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cd170-73bf-4101-a5cd-9bf047b47312 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:24.330648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cd170-73bf-4101-a5cd-9bf047b47312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:24.349289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ba3cd170-73bf-4101-a5cd-9bf047b47312 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:24.350503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ba3cd170-73bf-4101-a5cd-9bf047b47312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:24.358385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 671/1368] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:24.404221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775f327-e3fa-4ac6-9ea2-3ea2d7208401 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:24.404524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775f327-e3fa-4ac6-9ea2-3ea2d7208401 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:24.404807 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775f327-e3fa-4ac6-9ea2-3ea2d7208401 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:24.406606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 698/1369] 10.222.0.16 () {54 vars in 961 bytes} [Thu Mar 10 17:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:24.411867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f9821-9b6e-47fc-8ffc-c8cf8cf06204 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:24.412182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f9821-9b6e-47fc-8ffc-c8cf8cf06204 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:24.412459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f9821-9b6e-47fc-8ffc-c8cf8cf06204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:24.430637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bb7f9821-9b6e-47fc-8ffc-c8cf8cf06204 None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:24.431863 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bb7f9821-9b6e-47fc-8ffc-c8cf8cf06204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:24.441536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 672/1370] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Mar 10 17:17:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:24.449346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775f327-e3fa-4ac6-9ea2-3ea2d7208401 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:24.463826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775f327-e3fa-4ac6-9ea2-3ea2d7208401 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:24.469283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f5f87-932d-4426-bc5a-a0700276cd84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:24.469912 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5f87-932d-4426-bc5a-a0700276cd84 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:24.470231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5f87-932d-4426-bc5a-a0700276cd84 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:24.470512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5f87-932d-4426-bc5a-a0700276cd84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:24.479002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f5f87-932d-4426-bc5a-a0700276cd84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:24.480565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f5f87-932d-4426-bc5a-a0700276cd84 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:24.490292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 699/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:26.890201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9865887-88a6-4207-9a2c-f93764032809 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:26.891105 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9865887-88a6-4207-9a2c-f93764032809 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:26.891105 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9865887-88a6-4207-9a2c-f93764032809 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:26.892544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 673/1372] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:26.901803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba671b-c5de-42ad-9a6a-34f5528ea30d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:26.904512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba671b-c5de-42ad-9a6a-34f5528ea30d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:26.904512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba671b-c5de-42ad-9a6a-34f5528ea30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:26.922896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e8ba671b-c5de-42ad-9a6a-34f5528ea30d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:26.924200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e8ba671b-c5de-42ad-9a6a-34f5528ea30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:26.928225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8c325-1df9-454e-9339-73ef66965a40 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:26.928519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8c325-1df9-454e-9339-73ef66965a40 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:26.928795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8c325-1df9-454e-9339-73ef66965a40 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:26.931104 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 674/1373] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 17:17:26.932380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 700/1374] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:17:26.937043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eb15e-8b6b-4f14-83ad-90c3dca0396c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:26.937340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eb15e-8b6b-4f14-83ad-90c3dca0396c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:26.937630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eb15e-8b6b-4f14-83ad-90c3dca0396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:26.957014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-115eb15e-8b6b-4f14-83ad-90c3dca0396c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:26.958320 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-115eb15e-8b6b-4f14-83ad-90c3dca0396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:26.970616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 675/1375] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:17:26.979172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba671b-c5de-42ad-9a6a-34f5528ea30d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:26.992333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba671b-c5de-42ad-9a6a-34f5528ea30d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:26.998790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acc5ba-bce8-44b9-9f9e-144a1c20d6a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:26.999447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acc5ba-bce8-44b9-9f9e-144a1c20d6a7 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:26.999730 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acc5ba-bce8-44b9-9f9e-144a1c20d6a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:27.000004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acc5ba-bce8-44b9-9f9e-144a1c20d6a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:27.008973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acc5ba-bce8-44b9-9f9e-144a1c20d6a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:27.010581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acc5ba-bce8-44b9-9f9e-144a1c20d6a7 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:27.021587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 701/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:27.278192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b60e-c144-4f08-87b4-e65468f0fdaf None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:27.278560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b60e-c144-4f08-87b4-e65468f0fdaf None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:27.278918 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b60e-c144-4f08-87b4-e65468f0fdaf None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:27.280984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 676/1377] 10.222.0.16 () {54 vars in 963 bytes} [Thu Mar 10 17:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:27.285885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2352c-96ed-416f-9be7-8200379515be None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:27.286303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2352c-96ed-416f-9be7-8200379515be None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:27.286662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2352c-96ed-416f-9be7-8200379515be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:27.345025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-14e2352c-96ed-416f-9be7-8200379515be None None] MFA Rules not processed for user `9f582002cd7141428072dacd218dbe86`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:27.346400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-14e2352c-96ed-416f-9be7-8200379515be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:27.404972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 702/1378] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Mar 10 17:17:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:27.412539 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2b60e-c144-4f08-87b4-e65468f0fdaf None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:27.423919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2b60e-c144-4f08-87b4-e65468f0fdaf None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:27.427679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4550c31-7ad8-452a-9097-775937c26243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:27.428322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4550c31-7ad8-452a-9097-775937c26243 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:27.428607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4550c31-7ad8-452a-9097-775937c26243 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:27.429509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4550c31-7ad8-452a-9097-775937c26243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:27.439211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4550c31-7ad8-452a-9097-775937c26243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:27.440649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4550c31-7ad8-452a-9097-775937c26243 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:27.450339 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 677/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:17:29.366472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7426be5-ac11-4ab2-a90c-48340b031d6d None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:29.366991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7426be5-ac11-4ab2-a90c-48340b031d6d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:29.367098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7426be5-ac11-4ab2-a90c-48340b031d6d None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:29.368793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 703/1380] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:29.374566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefc29a-4d86-41b8-9aea-f40316c37342 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:29.374988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefc29a-4d86-41b8-9aea-f40316c37342 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:29.375121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefc29a-4d86-41b8-9aea-f40316c37342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:29.393558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ebefc29a-4d86-41b8-9aea-f40316c37342 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:29.394800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ebefc29a-4d86-41b8-9aea-f40316c37342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:29.402949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 678/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:29.447406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7426be5-ac11-4ab2-a90c-48340b031d6d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:29.461344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7426be5-ac11-4ab2-a90c-48340b031d6d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:29.466818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2b0c0-2779-4985-be3d-fe52ae3ab864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:29.467450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2b0c0-2779-4985-be3d-fe52ae3ab864 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:29.467729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2b0c0-2779-4985-be3d-fe52ae3ab864 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:29.468005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2b0c0-2779-4985-be3d-fe52ae3ab864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:29.476114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2b0c0-2779-4985-be3d-fe52ae3ab864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:29.477682 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2b0c0-2779-4985-be3d-fe52ae3ab864 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:29.488364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 704/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:31.856775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66e9aa-1cd6-4b01-9cb4-fafebc01f2db None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:31.857303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66e9aa-1cd6-4b01-9cb4-fafebc01f2db None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:31.857303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66e9aa-1cd6-4b01-9cb4-fafebc01f2db None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:31.859577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 679/1383] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:31.864672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf06e5-a9ae-4c71-ad6c-fbb3eef151cd None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:31.865055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf06e5-a9ae-4c71-ad6c-fbb3eef151cd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:31.865216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf06e5-a9ae-4c71-ad6c-fbb3eef151cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:31.886879 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-28cf06e5-a9ae-4c71-ad6c-fbb3eef151cd None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:31.888578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-28cf06e5-a9ae-4c71-ad6c-fbb3eef151cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:31.896485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 705/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:31.940409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66e9aa-1cd6-4b01-9cb4-fafebc01f2db None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:31.954345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66e9aa-1cd6-4b01-9cb4-fafebc01f2db None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:31.959868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9797dc-8659-4ac9-8c13-38cb9c28ff7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:31.960512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9797dc-8659-4ac9-8c13-38cb9c28ff7d service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:31.960793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9797dc-8659-4ac9-8c13-38cb9c28ff7d service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:31.961098 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9797dc-8659-4ac9-8c13-38cb9c28ff7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:31.969428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9797dc-8659-4ac9-8c13-38cb9c28ff7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:31.971013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9797dc-8659-4ac9-8c13-38cb9c28ff7d service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:31.980341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 680/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:34.333286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5ce48-28e4-4a58-a414-3867ab369dce None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:34.333814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5ce48-28e4-4a58-a414-3867ab369dce None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:34.333814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5ce48-28e4-4a58-a414-3867ab369dce None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:34.335612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 706/1386] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:34.340821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d010f7-899a-4366-9246-6a83fb7d79c3 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:34.341204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d010f7-899a-4366-9246-6a83fb7d79c3 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:34.341374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d010f7-899a-4366-9246-6a83fb7d79c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:34.358743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-36d010f7-899a-4366-9246-6a83fb7d79c3 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:34.359912 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-36d010f7-899a-4366-9246-6a83fb7d79c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:34.382137 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 681/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:34.409938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5ce48-28e4-4a58-a414-3867ab369dce None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:34.425103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5ce48-28e4-4a58-a414-3867ab369dce None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:34.430823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d598948-fda6-4bca-b39c-396273ac779f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:34.431557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598948-fda6-4bca-b39c-396273ac779f service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:34.431905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598948-fda6-4bca-b39c-396273ac779f service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:34.432292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598948-fda6-4bca-b39c-396273ac779f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:34.441954 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d598948-fda6-4bca-b39c-396273ac779f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:34.443649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d598948-fda6-4bca-b39c-396273ac779f service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:34.454303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 707/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:36.782445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181aced-79c9-45d3-adeb-5472309607b6 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:36.783073 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181aced-79c9-45d3-adeb-5472309607b6 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:36.783223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181aced-79c9-45d3-adeb-5472309607b6 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:36.785615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 682/1389] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:36.791037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0fd5-25bc-4852-bc69-b97e2e1e5d51 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:36.791472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0fd5-25bc-4852-bc69-b97e2e1e5d51 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:36.791595 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0fd5-25bc-4852-bc69-b97e2e1e5d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:36.810085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-993a0fd5-25bc-4852-bc69-b97e2e1e5d51 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:36.811353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-993a0fd5-25bc-4852-bc69-b97e2e1e5d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:36.820055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 708/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:36.865659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181aced-79c9-45d3-adeb-5472309607b6 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:36.882219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181aced-79c9-45d3-adeb-5472309607b6 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:36.889151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940acb2c-68f0-49fc-b90d-53381b6690e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:36.889975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940acb2c-68f0-49fc-b90d-53381b6690e3 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:36.890545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940acb2c-68f0-49fc-b90d-53381b6690e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:36.890919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940acb2c-68f0-49fc-b90d-53381b6690e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:36.901787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940acb2c-68f0-49fc-b90d-53381b6690e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:36.903894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940acb2c-68f0-49fc-b90d-53381b6690e3 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:36.916602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 683/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:39.553668 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7efbc-8b49-4f17-9c80-0c18f5586c2d None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:39.554243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7efbc-8b49-4f17-9c80-0c18f5586c2d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:39.554243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7efbc-8b49-4f17-9c80-0c18f5586c2d None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:39.556032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 709/1392] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:39.562732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4a6f-cb5f-4b7a-9e01-dc44e9a61791 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:39.563131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4a6f-cb5f-4b7a-9e01-dc44e9a61791 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:39.563222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4a6f-cb5f-4b7a-9e01-dc44e9a61791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:39.581751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9adb4a6f-cb5f-4b7a-9e01-dc44e9a61791 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:39.582976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9adb4a6f-cb5f-4b7a-9e01-dc44e9a61791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:39.590927 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 684/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:39.645533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7efbc-8b49-4f17-9c80-0c18f5586c2d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:39.659759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7efbc-8b49-4f17-9c80-0c18f5586c2d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:39.665558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2438445-3304-4814-91ae-f4270c41abac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:39.666230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2438445-3304-4814-91ae-f4270c41abac service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:39.666521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2438445-3304-4814-91ae-f4270c41abac service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:39.666808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2438445-3304-4814-91ae-f4270c41abac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:39.674935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2438445-3304-4814-91ae-f4270c41abac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:39.676476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2438445-3304-4814-91ae-f4270c41abac service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:39.685753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 710/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:42.035814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33727d-b4f0-43e9-a199-42ede2a47e2a None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:42.036414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33727d-b4f0-43e9-a199-42ede2a47e2a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:42.036414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33727d-b4f0-43e9-a199-42ede2a47e2a None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:42.038162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 685/1395] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:42.043476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee64134-4b05-42aa-bd38-62f500e529b1 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:42.043885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee64134-4b05-42aa-bd38-62f500e529b1 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:42.044024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee64134-4b05-42aa-bd38-62f500e529b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:42.061346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-6ee64134-4b05-42aa-bd38-62f500e529b1 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:42.062608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6ee64134-4b05-42aa-bd38-62f500e529b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:42.070359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 711/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:42.114837 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33727d-b4f0-43e9-a199-42ede2a47e2a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:42.129128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33727d-b4f0-43e9-a199-42ede2a47e2a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:42.134547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccbf53-8222-4293-b2ff-83f3cd0c7b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:42.135182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccbf53-8222-4293-b2ff-83f3cd0c7b9e service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:42.135465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccbf53-8222-4293-b2ff-83f3cd0c7b9e service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:42.135739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccbf53-8222-4293-b2ff-83f3cd0c7b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:42.144323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccbf53-8222-4293-b2ff-83f3cd0c7b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:42.145912 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccbf53-8222-4293-b2ff-83f3cd0c7b9e service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:42.157493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 686/1397] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:43.334699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658429-71a8-433e-87c0-e7fb3c2fd169 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:43.335243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658429-71a8-433e-87c0-e7fb3c2fd169 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:43.335243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658429-71a8-433e-87c0-e7fb3c2fd169 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:43.337022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 712/1398] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:43.342191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66fd71-484f-4a06-9af7-49a74d086ed5 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:43.342636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66fd71-484f-4a06-9af7-49a74d086ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:43.342973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66fd71-484f-4a06-9af7-49a74d086ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:43.361065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-da66fd71-484f-4a06-9af7-49a74d086ed5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:43.362409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-da66fd71-484f-4a06-9af7-49a74d086ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:43.370635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 687/1399] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:43.426644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839d0c0-eaee-4554-b883-366ac0289283 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:43.426936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839d0c0-eaee-4554-b883-366ac0289283 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:43.427215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839d0c0-eaee-4554-b883-366ac0289283 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:43.428964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 713/1400] 10.222.0.16 () {54 vars in 961 bytes} [Thu Mar 10 17:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:43.433730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45722c3-a67f-4042-8854-4d2b45b936ad None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:43.434024 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45722c3-a67f-4042-8854-4d2b45b936ad None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:43.434338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45722c3-a67f-4042-8854-4d2b45b936ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:43.480870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a45722c3-a67f-4042-8854-4d2b45b936ad None None] MFA Rules not processed for user `ad9a11df2d3d4dc292a5115de69bb288`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:43.482050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a45722c3-a67f-4042-8854-4d2b45b936ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:43.538373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 688/1401] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Mar 10 17:17:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:43.545745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839d0c0-eaee-4554-b883-366ac0289283 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:43.556582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839d0c0-eaee-4554-b883-366ac0289283 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:43.560160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d81bf-981f-4d52-89e6-96d041b8e4dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9a11df2d3d4dc292a5115de69bb288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:43.560725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d81bf-981f-4d52-89e6-96d041b8e4dd service glance] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:43.561002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d81bf-981f-4d52-89e6-96d041b8e4dd service glance] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:43.561274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d81bf-981f-4d52-89e6-96d041b8e4dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:43.570442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d81bf-981f-4d52-89e6-96d041b8e4dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:43.571988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d81bf-981f-4d52-89e6-96d041b8e4dd service glance] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:43.581346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 714/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:17:43.995224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4721cc-ffb5-4727-9e96-81d8c421ff09 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:43.995520 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4721cc-ffb5-4727-9e96-81d8c421ff09 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:43.995801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4721cc-ffb5-4727-9e96-81d8c421ff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:44.043570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-0b4721cc-ffb5-4727-9e96-81d8c421ff09 None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:44.044757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0b4721cc-ffb5-4727-9e96-81d8c421ff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:44.107665 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 689/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:17:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:44.153268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901a7fb-4dd5-40e1-bbc7-21b5bec8125a None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:44.153564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901a7fb-4dd5-40e1-bbc7-21b5bec8125a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:44.153846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901a7fb-4dd5-40e1-bbc7-21b5bec8125a None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:44.156186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 715/1404] 10.222.0.16 () {54 vars in 942 bytes} [Thu Mar 10 17:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:44.162837 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a95b7d-5b69-4c44-8670-c34532cb93ab None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:44.163127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a95b7d-5b69-4c44-8670-c34532cb93ab None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:44.163402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a95b7d-5b69-4c44-8670-c34532cb93ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:44.210121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-23a95b7d-5b69-4c44-8670-c34532cb93ab None None] MFA Rules not processed for user `35cc9fe9f62844a38f78d52435186f26`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:44.211303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-23a95b7d-5b69-4c44-8670-c34532cb93ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:44.279284 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 690/1405] 10.222.0.16 () {58 vars in 1039 bytes} [Thu Mar 10 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:17:44.289448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901a7fb-4dd5-40e1-bbc7-21b5bec8125a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:44.303245 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901a7fb-4dd5-40e1-bbc7-21b5bec8125a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:44.308806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2309f-d3aa-4bb3-8ed1-300ac3f5643b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:44.309552 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2309f-d3aa-4bb3-8ed1-300ac3f5643b service swift] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:44.309910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2309f-d3aa-4bb3-8ed1-300ac3f5643b service swift] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:44.310408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2309f-d3aa-4bb3-8ed1-300ac3f5643b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:44.318815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2309f-d3aa-4bb3-8ed1-300ac3f5643b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:44.320447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2309f-d3aa-4bb3-8ed1-300ac3f5643b service swift] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:44.328787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 716/1406] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:17:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:17:44.478736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b57ab-603e-4d96-97ed-4cdf8739e608 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:44.479641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b57ab-603e-4d96-97ed-4cdf8739e608 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:44.480091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b57ab-603e-4d96-97ed-4cdf8739e608 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:44.481876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 691/1407] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:44.487190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcabaa-211b-4f41-ab4f-dbbeaaa8dac6 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:44.487929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcabaa-211b-4f41-ab4f-dbbeaaa8dac6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:44.488215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcabaa-211b-4f41-ab4f-dbbeaaa8dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:44.506579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-7ddcabaa-211b-4f41-ab4f-dbbeaaa8dac6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:44.507819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7ddcabaa-211b-4f41-ab4f-dbbeaaa8dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:44.516512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 717/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:17:44.561938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b57ab-603e-4d96-97ed-4cdf8739e608 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:44.578707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b57ab-603e-4d96-97ed-4cdf8739e608 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:44.584400 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec5082-dd22-43ab-9344-11a7f4105512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:44.585039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5082-dd22-43ab-9344-11a7f4105512 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:44.585325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5082-dd22-43ab-9344-11a7f4105512 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:44.585604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5082-dd22-43ab-9344-11a7f4105512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:44.593900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec5082-dd22-43ab-9344-11a7f4105512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:44.595530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec5082-dd22-43ab-9344-11a7f4105512 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:44.610427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 692/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:17:46.973291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f09377-9df5-4654-b58e-1281c87c1d0e None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:46.973857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f09377-9df5-4654-b58e-1281c87c1d0e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:46.973857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f09377-9df5-4654-b58e-1281c87c1d0e None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:46.978472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 718/1410] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:17:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:17:46.980736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13f303-a50b-4c8a-96eb-30cc740dad16 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:46.981173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13f303-a50b-4c8a-96eb-30cc740dad16 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:46.981368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13f303-a50b-4c8a-96eb-30cc740dad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:46.999782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-fb13f303-a50b-4c8a-96eb-30cc740dad16 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:17:47.000971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fb13f303-a50b-4c8a-96eb-30cc740dad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:17:47.009175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 693/1411] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:17:47.052648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f09377-9df5-4654-b58e-1281c87c1d0e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:17:47.068246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f09377-9df5-4654-b58e-1281c87c1d0e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:17:47.073878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb857c1-740c-4928-b3b9-0924fe831089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:17:47.074641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb857c1-740c-4928-b3b9-0924fe831089 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:17:47.075003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb857c1-740c-4928-b3b9-0924fe831089 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:17:47.075343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb857c1-740c-4928-b3b9-0924fe831089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:17:47.084290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb857c1-740c-4928-b3b9-0924fe831089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:17:47.085958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb857c1-740c-4928-b3b9-0924fe831089 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:17:47.095952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 719/1412] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:07.682343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e1464-b5df-4b07-aaf5-af348ce2da96 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:07.683295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e1464-b5df-4b07-aaf5-af348ce2da96 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:07.683295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e1464-b5df-4b07-aaf5-af348ce2da96 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:07.684615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 694/1413] 10.222.0.16 () {54 vars in 918 bytes} [Thu Mar 10 17:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:07.690705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ef1fb-fdce-4ca7-92df-41efa05b031f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:07.691175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ef1fb-fdce-4ca7-92df-41efa05b031f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:07.691283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ef1fb-fdce-4ca7-92df-41efa05b031f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:07.709320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c88ef1fb-fdce-4ca7-92df-41efa05b031f None None] MFA Rules not processed for user `a35ae873d42b490cae4dd610f2ac6a60`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:07.710584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c88ef1fb-fdce-4ca7-92df-41efa05b031f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:07.719644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 720/1414] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Mar 10 17:18:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:07.734546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6100f-fd20-4f87-bcf9-234e7266edd1 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:07.734833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6100f-fd20-4f87-bcf9-234e7266edd1 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:07.735104 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6100f-fd20-4f87-bcf9-234e7266edd1 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:07.736919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 695/1415] 10.222.0.16 () {54 vars in 918 bytes} [Thu Mar 10 17:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:07.741681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a05c-288a-4291-9c37-8e66bf4de3ee None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:07.741970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a05c-288a-4291-9c37-8e66bf4de3ee None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:07.742291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a05c-288a-4291-9c37-8e66bf4de3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:07.760586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-29a1a05c-288a-4291-9c37-8e66bf4de3ee None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:07.761770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-29a1a05c-288a-4291-9c37-8e66bf4de3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:07.770785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 721/1416] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Mar 10 17:18:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:10.536763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bdb81-f85a-4f11-b5a7-3c0da3ae44a7 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:10.537351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bdb81-f85a-4f11-b5a7-3c0da3ae44a7 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:10.537351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bdb81-f85a-4f11-b5a7-3c0da3ae44a7 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:10.539489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:10.544781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ce05-ae30-4256-8abb-aa5bd8485ca4 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:10.545204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ce05-ae30-4256-8abb-aa5bd8485ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:10.545811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ce05-ae30-4256-8abb-aa5bd8485ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:10.563757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f606ce05-ae30-4256-8abb-aa5bd8485ca4 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:10.564863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f606ce05-ae30-4256-8abb-aa5bd8485ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:10.572475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:10.613778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bdb81-f85a-4f11-b5a7-3c0da3ae44a7 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:10.628295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bdb81-f85a-4f11-b5a7-3c0da3ae44a7 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:10.633530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8087d90-9df9-492d-89d9-788ff06ba4e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:10.634187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8087d90-9df9-492d-89d9-788ff06ba4e3 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:10.634471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8087d90-9df9-492d-89d9-788ff06ba4e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:10.634743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8087d90-9df9-492d-89d9-788ff06ba4e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:10.642589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8087d90-9df9-492d-89d9-788ff06ba4e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:10.644146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8087d90-9df9-492d-89d9-788ff06ba4e3 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:10.653151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 697/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:11.995602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cec66-d9ed-4d0d-82e5-0272f42727a7 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:11.996167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cec66-d9ed-4d0d-82e5-0272f42727a7 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:11.996167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cec66-d9ed-4d0d-82e5-0272f42727a7 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:11.997919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:12.003384 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3240-d92b-4736-aeb1-94877c90dad2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:12.003832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3240-d92b-4736-aeb1-94877c90dad2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:12.003982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3240-d92b-4736-aeb1-94877c90dad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:12.024319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ee0d3240-d92b-4736-aeb1-94877c90dad2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:12.025517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ee0d3240-d92b-4736-aeb1-94877c90dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:12.033435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:12.201892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cec66-d9ed-4d0d-82e5-0272f42727a7 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:12.215689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cec66-d9ed-4d0d-82e5-0272f42727a7 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:12.221188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab7495-44a8-48cc-bd1a-8a1545cd9cff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:12.221826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab7495-44a8-48cc-bd1a-8a1545cd9cff service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:12.222137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab7495-44a8-48cc-bd1a-8a1545cd9cff service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:12.222419 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab7495-44a8-48cc-bd1a-8a1545cd9cff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:12.230501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab7495-44a8-48cc-bd1a-8a1545cd9cff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:12.232080 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab7495-44a8-48cc-bd1a-8a1545cd9cff service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:12.241772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 724/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:13.541200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361543d-f7aa-45a3-bb17-30823f1f5886 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:13.541627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361543d-f7aa-45a3-bb17-30823f1f5886 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:13.541765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361543d-f7aa-45a3-bb17-30823f1f5886 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:13.543632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:13.549088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ed6b8-3d24-4605-a32b-a6fa6fb58e52 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:13.549536 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ed6b8-3d24-4605-a32b-a6fa6fb58e52 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:13.549642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ed6b8-3d24-4605-a32b-a6fa6fb58e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:13.567945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e76ed6b8-3d24-4605-a32b-a6fa6fb58e52 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:13.569066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e76ed6b8-3d24-4605-a32b-a6fa6fb58e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:13.576742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:13.723884 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361543d-f7aa-45a3-bb17-30823f1f5886 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:13.738332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361543d-f7aa-45a3-bb17-30823f1f5886 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:13.743600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eac23-6530-41a5-9bce-81661f576f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:13.744229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eac23-6530-41a5-9bce-81661f576f72 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:13.744515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eac23-6530-41a5-9bce-81661f576f72 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:13.744792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eac23-6530-41a5-9bce-81661f576f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:13.753150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eac23-6530-41a5-9bce-81661f576f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:13.754758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eac23-6530-41a5-9bce-81661f576f72 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:13.763783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 700/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:15.051093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328777-fc32-47f1-b18e-9dba32bc864f None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:15.051681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328777-fc32-47f1-b18e-9dba32bc864f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:15.051681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328777-fc32-47f1-b18e-9dba32bc864f None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:15.053393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:15.058395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b8f0a-5f9c-46e1-9211-fe3f5d93b74a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:15.058786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b8f0a-5f9c-46e1-9211-fe3f5d93b74a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:15.058952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b8f0a-5f9c-46e1-9211-fe3f5d93b74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:15.076940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-0e6b8f0a-5f9c-46e1-9211-fe3f5d93b74a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:15.078136 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0e6b8f0a-5f9c-46e1-9211-fe3f5d93b74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:15.085808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:15.235236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328777-fc32-47f1-b18e-9dba32bc864f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:15.250420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328777-fc32-47f1-b18e-9dba32bc864f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:15.256298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589c4ba-f8f3-4aed-80df-bb52a0b64e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:15.256922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589c4ba-f8f3-4aed-80df-bb52a0b64e0e service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:15.257289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589c4ba-f8f3-4aed-80df-bb52a0b64e0e service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:15.257561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589c4ba-f8f3-4aed-80df-bb52a0b64e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:15.265363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589c4ba-f8f3-4aed-80df-bb52a0b64e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:15.266960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589c4ba-f8f3-4aed-80df-bb52a0b64e0e service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:15.275951 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 727/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:18:16.583764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde25bd2-b1e6-472b-ba7d-88e533662e05 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:16.584293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde25bd2-b1e6-472b-ba7d-88e533662e05 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:16.584293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde25bd2-b1e6-472b-ba7d-88e533662e05 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:16.586152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:16.591159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8df9ee-786a-4180-ae06-463ceed65695 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:16.591579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8df9ee-786a-4180-ae06-463ceed65695 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:16.591749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8df9ee-786a-4180-ae06-463ceed65695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:16.609810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fb8df9ee-786a-4180-ae06-463ceed65695 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:16.611018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fb8df9ee-786a-4180-ae06-463ceed65695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:16.618678 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:18:16.769119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde25bd2-b1e6-472b-ba7d-88e533662e05 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:16.783018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde25bd2-b1e6-472b-ba7d-88e533662e05 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:16.788290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a3fc1-00a0-493c-bb93-4922c7615a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:16.788919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3fc1-00a0-493c-bb93-4922c7615a89 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:16.789473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3fc1-00a0-493c-bb93-4922c7615a89 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:16.789752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3fc1-00a0-493c-bb93-4922c7615a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:16.798017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a3fc1-00a0-493c-bb93-4922c7615a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:16.799619 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a3fc1-00a0-493c-bb93-4922c7615a89 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:16.809154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 703/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:18.079719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5df2e-ae10-4955-bf3a-428ab57d7f61 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:18.080286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5df2e-ae10-4955-bf3a-428ab57d7f61 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:18.080286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5df2e-ae10-4955-bf3a-428ab57d7f61 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:18.082054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:18.087079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce266f-ff8e-4f58-ae72-10272874fe4c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:18.087498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce266f-ff8e-4f58-ae72-10272874fe4c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:18.087639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce266f-ff8e-4f58-ae72-10272874fe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:18.104991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a3ce266f-ff8e-4f58-ae72-10272874fe4c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:18.106180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a3ce266f-ff8e-4f58-ae72-10272874fe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:18.114277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:18.266097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5df2e-ae10-4955-bf3a-428ab57d7f61 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:18.280096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5df2e-ae10-4955-bf3a-428ab57d7f61 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:18.285462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95d852-6e40-4aa4-93c6-d8f2421c6d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:18.286086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95d852-6e40-4aa4-93c6-d8f2421c6d0a service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:18.286402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95d852-6e40-4aa4-93c6-d8f2421c6d0a service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:18.286681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95d852-6e40-4aa4-93c6-d8f2421c6d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:18.294940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95d852-6e40-4aa4-93c6-d8f2421c6d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:18.297039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95d852-6e40-4aa4-93c6-d8f2421c6d0a service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:18.306305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 730/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:19.547387 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d349a89-43ea-4302-949b-3a1cdc4e71da None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:19.547835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d349a89-43ea-4302-949b-3a1cdc4e71da None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:19.547974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d349a89-43ea-4302-949b-3a1cdc4e71da None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:19.550002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:19.555079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323b03-ba9f-4200-811f-bfe4ed908e8c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:19.555500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323b03-ba9f-4200-811f-bfe4ed908e8c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:19.555641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323b03-ba9f-4200-811f-bfe4ed908e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:19.573843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-53323b03-ba9f-4200-811f-bfe4ed908e8c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:19.574989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-53323b03-ba9f-4200-811f-bfe4ed908e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:19.582713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:19.731201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d349a89-43ea-4302-949b-3a1cdc4e71da None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:19.745476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d349a89-43ea-4302-949b-3a1cdc4e71da None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:19.751380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd892e-688d-41d7-8094-adcc0ce55b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:19.752000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd892e-688d-41d7-8094-adcc0ce55b47 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:19.752281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd892e-688d-41d7-8094-adcc0ce55b47 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:19.752555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd892e-688d-41d7-8094-adcc0ce55b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:19.760519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd892e-688d-41d7-8094-adcc0ce55b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:19.762129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd892e-688d-41d7-8094-adcc0ce55b47 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:19.771529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 706/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:21.005314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b2f20-6f54-4046-b074-e2590a35d551 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:21.005890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b2f20-6f54-4046-b074-e2590a35d551 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:21.005890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b2f20-6f54-4046-b074-e2590a35d551 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:21.007666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:21.012562 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f32b10-fee2-4582-a33b-b9cad8f4ca92 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:21.012948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f32b10-fee2-4582-a33b-b9cad8f4ca92 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:21.013134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f32b10-fee2-4582-a33b-b9cad8f4ca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:21.032177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-82f32b10-fee2-4582-a33b-b9cad8f4ca92 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:21.033362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-82f32b10-fee2-4582-a33b-b9cad8f4ca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:21.041278 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:21.200064 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b2f20-6f54-4046-b074-e2590a35d551 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:21.214602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b2f20-6f54-4046-b074-e2590a35d551 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:21.220383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6200e55-40ad-4ab0-b212-6eefaf4dec08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:21.221007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200e55-40ad-4ab0-b212-6eefaf4dec08 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:21.221289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200e55-40ad-4ab0-b212-6eefaf4dec08 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:21.221562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200e55-40ad-4ab0-b212-6eefaf4dec08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:21.229300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6200e55-40ad-4ab0-b212-6eefaf4dec08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:21.230886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6200e55-40ad-4ab0-b212-6eefaf4dec08 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:21.240110 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 733/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:22.502799 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5137b6e-662f-4c12-8792-7f91f9a2f02a None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:22.503381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5137b6e-662f-4c12-8792-7f91f9a2f02a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:22.503381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5137b6e-662f-4c12-8792-7f91f9a2f02a None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:22.505139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:22.509949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac6964-3c3d-4a64-a507-1a284d9b695e None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:22.510427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac6964-3c3d-4a64-a507-1a284d9b695e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:22.510650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac6964-3c3d-4a64-a507-1a284d9b695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:22.530368 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-7bac6964-3c3d-4a64-a507-1a284d9b695e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:22.531641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7bac6964-3c3d-4a64-a507-1a284d9b695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:22.539924 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:22.688992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5137b6e-662f-4c12-8792-7f91f9a2f02a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:22.703338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5137b6e-662f-4c12-8792-7f91f9a2f02a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:22.708905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121636-b2a2-4807-a16e-5d309c162607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:22.709530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121636-b2a2-4807-a16e-5d309c162607 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:22.709814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121636-b2a2-4807-a16e-5d309c162607 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:22.710096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121636-b2a2-4807-a16e-5d309c162607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:22.718814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15121636-b2a2-4807-a16e-5d309c162607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:22.720381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15121636-b2a2-4807-a16e-5d309c162607 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:22.729430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 709/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:24.919213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef21b4b-0266-4745-b2af-af00b1226e16 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:24.919799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef21b4b-0266-4745-b2af-af00b1226e16 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:24.919799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef21b4b-0266-4745-b2af-af00b1226e16 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:24.922050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:24.927218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819f53-a46c-4df2-bc43-ef076a04ccec None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:24.927619 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819f53-a46c-4df2-bc43-ef076a04ccec None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:24.927785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819f53-a46c-4df2-bc43-ef076a04ccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:24.945952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-90819f53-a46c-4df2-bc43-ef076a04ccec None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:24.947160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-90819f53-a46c-4df2-bc43-ef076a04ccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:24.954892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:24.993830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef21b4b-0266-4745-b2af-af00b1226e16 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:24.995569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4ef21b4b-0266-4745-b2af-af00b1226e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:25.008988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef21b4b-0266-4745-b2af-af00b1226e16 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:25.012527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faca80-7f0c-424f-83ef-f304366fc6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:25.013163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faca80-7f0c-424f-83ef-f304366fc6ae service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:25.013449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faca80-7f0c-424f-83ef-f304366fc6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:25.013727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faca80-7f0c-424f-83ef-f304366fc6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:25.022375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faca80-7f0c-424f-83ef-f304366fc6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:25.023784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faca80-7f0c-424f-83ef-f304366fc6ae service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:25.032931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 736/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:27.480286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c16d-e61b-4ccb-9215-a7989702b7a9 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:27.480850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c16d-e61b-4ccb-9215-a7989702b7a9 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:27.480850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c16d-e61b-4ccb-9215-a7989702b7a9 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:27.482731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:27.488514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643e4d-60b0-4817-8011-d481eaaf5d78 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:27.488957 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643e4d-60b0-4817-8011-d481eaaf5d78 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:27.489065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643e4d-60b0-4817-8011-d481eaaf5d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:27.506422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-bd643e4d-60b0-4817-8011-d481eaaf5d78 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:27.507638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-bd643e4d-60b0-4817-8011-d481eaaf5d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:27.515318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:27.553272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c16d-e61b-4ccb-9215-a7989702b7a9 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:27.564040 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c16d-e61b-4ccb-9215-a7989702b7a9 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:27.567474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89637f5-1123-4bdb-939f-4dec04002b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:27.568098 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89637f5-1123-4bdb-939f-4dec04002b50 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:27.568381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89637f5-1123-4bdb-939f-4dec04002b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:27.568658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89637f5-1123-4bdb-939f-4dec04002b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:27.577244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89637f5-1123-4bdb-939f-4dec04002b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:27.578708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89637f5-1123-4bdb-939f-4dec04002b50 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:27.587781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 712/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:30.157701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9284e0-fc6e-4adb-9083-3d7ac0de2d78 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:30.158324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9284e0-fc6e-4adb-9083-3d7ac0de2d78 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:30.158324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9284e0-fc6e-4adb-9083-3d7ac0de2d78 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:30.160062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:30.165508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321324ed-ab6c-45d8-ab50-82012418cd59 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:30.165917 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321324ed-ab6c-45d8-ab50-82012418cd59 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:30.166066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321324ed-ab6c-45d8-ab50-82012418cd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:30.184547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-321324ed-ab6c-45d8-ab50-82012418cd59 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:30.186368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-321324ed-ab6c-45d8-ab50-82012418cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:30.193964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:18:30.233432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9284e0-fc6e-4adb-9083-3d7ac0de2d78 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:30.243847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9284e0-fc6e-4adb-9083-3d7ac0de2d78 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:30.247294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba9186-f04e-4243-8a23-7d7ff4f21cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:30.247921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9186-f04e-4243-8a23-7d7ff4f21cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:30.248812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9186-f04e-4243-8a23-7d7ff4f21cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:30.249076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9186-f04e-4243-8a23-7d7ff4f21cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:30.257795 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba9186-f04e-4243-8a23-7d7ff4f21cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:30.259239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba9186-f04e-4243-8a23-7d7ff4f21cc0 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:30.268334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 739/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:32.667721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93655c46-1b12-42ee-b023-43ee3572b550 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:32.668242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93655c46-1b12-42ee-b023-43ee3572b550 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:32.668242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93655c46-1b12-42ee-b023-43ee3572b550 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:32.669977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:32.675095 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730853-bbd4-45db-bad1-bd7e9a23cddb None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:32.675476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730853-bbd4-45db-bad1-bd7e9a23cddb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:32.675654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730853-bbd4-45db-bad1-bd7e9a23cddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:32.693498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-1e730853-bbd4-45db-bad1-bd7e9a23cddb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:32.694719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1e730853-bbd4-45db-bad1-bd7e9a23cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:32.703037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:32.740242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93655c46-1b12-42ee-b023-43ee3572b550 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:32.751616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93655c46-1b12-42ee-b023-43ee3572b550 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:32.755129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0f610-f154-4f2e-a9df-a52332e9c4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:32.755755 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f610-f154-4f2e-a9df-a52332e9c4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:32.756033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f610-f154-4f2e-a9df-a52332e9c4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:32.756306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f610-f154-4f2e-a9df-a52332e9c4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:32.765573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0f610-f154-4f2e-a9df-a52332e9c4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:32.767011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0f610-f154-4f2e-a9df-a52332e9c4a2 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:32.776052 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 715/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:35.125561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67e5f5-1192-4409-8534-85fcc29c2c9d None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:35.126155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67e5f5-1192-4409-8534-85fcc29c2c9d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:35.126155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67e5f5-1192-4409-8534-85fcc29c2c9d None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:35.127989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:35.133427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef36a-56c1-4d8b-a26c-7808fb7438a9 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:35.133867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef36a-56c1-4d8b-a26c-7808fb7438a9 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:35.133981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef36a-56c1-4d8b-a26c-7808fb7438a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:35.151978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-601ef36a-56c1-4d8b-a26c-7808fb7438a9 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:35.153171 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-601ef36a-56c1-4d8b-a26c-7808fb7438a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:35.160885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:35.198425 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67e5f5-1192-4409-8534-85fcc29c2c9d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:35.209642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67e5f5-1192-4409-8534-85fcc29c2c9d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:35.213147 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4269af6-7947-420d-87b3-cbf452309159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:35.213809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4269af6-7947-420d-87b3-cbf452309159 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:35.214094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4269af6-7947-420d-87b3-cbf452309159 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:35.214405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4269af6-7947-420d-87b3-cbf452309159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:35.223696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4269af6-7947-420d-87b3-cbf452309159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:35.225108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4269af6-7947-420d-87b3-cbf452309159 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:35.234734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 742/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:18:37.594493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c112-a706-4bf8-a9ec-ee25582d8596 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:37.594976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c112-a706-4bf8-a9ec-ee25582d8596 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:37.594976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c112-a706-4bf8-a9ec-ee25582d8596 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:37.596737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:37.602125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73131ec-0399-483d-a8af-77fdd47b85c0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:37.602557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73131ec-0399-483d-a8af-77fdd47b85c0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:37.602691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73131ec-0399-483d-a8af-77fdd47b85c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:37.619907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a73131ec-0399-483d-a8af-77fdd47b85c0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:37.621088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a73131ec-0399-483d-a8af-77fdd47b85c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:37.628693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:37.667443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c112-a706-4bf8-a9ec-ee25582d8596 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:37.678322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c112-a706-4bf8-a9ec-ee25582d8596 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:37.681778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4730-85e8-44d8-8881-486f85d638a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:37.682449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4730-85e8-44d8-8881-486f85d638a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:37.682733 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4730-85e8-44d8-8881-486f85d638a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:37.683009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4730-85e8-44d8-8881-486f85d638a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:37.691701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4730-85e8-44d8-8881-486f85d638a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:37.693113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4730-85e8-44d8-8881-486f85d638a2 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:37.702664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 718/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:40.030053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e223ae0-bfd6-456d-949a-812c80c03c65 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:40.030641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e223ae0-bfd6-456d-949a-812c80c03c65 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:40.030641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e223ae0-bfd6-456d-949a-812c80c03c65 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:40.032401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:40.037525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ffa6-3ab8-4ac2-93e3-5c38e8bc01cc None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:40.037934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ffa6-3ab8-4ac2-93e3-5c38e8bc01cc None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:40.038122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ffa6-3ab8-4ac2-93e3-5c38e8bc01cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:40.055675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-c0b4ffa6-3ab8-4ac2-93e3-5c38e8bc01cc None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:40.056860 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c0b4ffa6-3ab8-4ac2-93e3-5c38e8bc01cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:40.065001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:40.102404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e223ae0-bfd6-456d-949a-812c80c03c65 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:40.112938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e223ae0-bfd6-456d-949a-812c80c03c65 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:40.116411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245b276-f41c-4433-b18c-ba6b66eefdd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:40.117039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245b276-f41c-4433-b18c-ba6b66eefdd9 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:40.117320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245b276-f41c-4433-b18c-ba6b66eefdd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:40.117593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245b276-f41c-4433-b18c-ba6b66eefdd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:40.126660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245b276-f41c-4433-b18c-ba6b66eefdd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:40.128056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245b276-f41c-4433-b18c-ba6b66eefdd9 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:40.137005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 745/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:42.431847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf338f4-8ebf-4fc9-8bc6-bbd2d139dc2f None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:42.432437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf338f4-8ebf-4fc9-8bc6-bbd2d139dc2f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:42.432437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf338f4-8ebf-4fc9-8bc6-bbd2d139dc2f None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:42.434173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:42.439363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aa850-b154-4203-93e7-defbfbda1005 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:42.439802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aa850-b154-4203-93e7-defbfbda1005 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:42.439961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aa850-b154-4203-93e7-defbfbda1005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:42.457279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9d9aa850-b154-4203-93e7-defbfbda1005 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:42.458530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9d9aa850-b154-4203-93e7-defbfbda1005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:42.466210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:42.503585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf338f4-8ebf-4fc9-8bc6-bbd2d139dc2f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:42.513809 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf338f4-8ebf-4fc9-8bc6-bbd2d139dc2f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:42.517252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dc2ad-bebb-455e-9ef5-8369da53c29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:42.517875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dc2ad-bebb-455e-9ef5-8369da53c29b service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:42.518187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dc2ad-bebb-455e-9ef5-8369da53c29b service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:42.518465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dc2ad-bebb-455e-9ef5-8369da53c29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:42.526963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dc2ad-bebb-455e-9ef5-8369da53c29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:42.528364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dc2ad-bebb-455e-9ef5-8369da53c29b service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:42.537928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 721/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:44.848042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f863471-d8c3-42c7-abbf-51b823fafd97 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:44.848607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f863471-d8c3-42c7-abbf-51b823fafd97 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:44.848607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f863471-d8c3-42c7-abbf-51b823fafd97 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:44.850411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:44.855583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb9e56-8419-4f75-8846-cb6db9e87503 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:44.856013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb9e56-8419-4f75-8846-cb6db9e87503 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:44.856124 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb9e56-8419-4f75-8846-cb6db9e87503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:44.873942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-45fb9e56-8419-4f75-8846-cb6db9e87503 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:44.875134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-45fb9e56-8419-4f75-8846-cb6db9e87503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:44.882708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:18:44.918718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f863471-d8c3-42c7-abbf-51b823fafd97 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:44.929154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f863471-d8c3-42c7-abbf-51b823fafd97 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:44.932664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c0dfe-b068-480b-aaf6-b08e298a1e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:44.933294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c0dfe-b068-480b-aaf6-b08e298a1e3a service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:44.933582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c0dfe-b068-480b-aaf6-b08e298a1e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:44.933863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c0dfe-b068-480b-aaf6-b08e298a1e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:44.943065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c0dfe-b068-480b-aaf6-b08e298a1e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:44.944487 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c0dfe-b068-480b-aaf6-b08e298a1e3a service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:44.954217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 748/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:18:47.250586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350c11b-21ee-4a17-8b3b-89507ff7da0f None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:47.251175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350c11b-21ee-4a17-8b3b-89507ff7da0f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:47.251175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350c11b-21ee-4a17-8b3b-89507ff7da0f None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:47.252941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 723/1471] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:18:47.257990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30344bf-edf1-4673-8045-cbdafa9a4922 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:47.258413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30344bf-edf1-4673-8045-cbdafa9a4922 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:47.258579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30344bf-edf1-4673-8045-cbdafa9a4922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:47.275642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c30344bf-edf1-4673-8045-cbdafa9a4922 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:18:47.276806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c30344bf-edf1-4673-8045-cbdafa9a4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:18:47.284387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 749/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:18:47.321029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350c11b-21ee-4a17-8b3b-89507ff7da0f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:18:47.331579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350c11b-21ee-4a17-8b3b-89507ff7da0f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:18:47.335097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92ab8e-9d9c-4237-a369-6a9d0382eba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:18:47.335727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92ab8e-9d9c-4237-a369-6a9d0382eba0 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:18:47.336013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92ab8e-9d9c-4237-a369-6a9d0382eba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:18:47.336321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92ab8e-9d9c-4237-a369-6a9d0382eba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:18:47.345694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92ab8e-9d9c-4237-a369-6a9d0382eba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:18:47.347152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92ab8e-9d9c-4237-a369-6a9d0382eba0 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:18:47.356296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 724/1473] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:19:07.915602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4846af-fd50-4053-b75e-c63f4e831cbb None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:07.916157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4846af-fd50-4053-b75e-c63f4e831cbb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:07.916157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4846af-fd50-4053-b75e-c63f4e831cbb None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:07.917877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 750/1474] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:19:07.923482 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf29f-70ca-4882-a989-d0e30fb5fa2a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:07.923897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf29f-70ca-4882-a989-d0e30fb5fa2a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:07.924035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf29f-70ca-4882-a989-d0e30fb5fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:07.941508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-41fdf29f-70ca-4882-a989-d0e30fb5fa2a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:19:07.942736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-41fdf29f-70ca-4882-a989-d0e30fb5fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:19:07.950531 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 725/1475] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:19:07.997134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a88f8-8538-4468-a6c9-0821dcfe533e None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:07.997431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a88f8-8538-4468-a6c9-0821dcfe533e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:07.997716 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a88f8-8538-4468-a6c9-0821dcfe533e None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:07.999622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 751/1476] 10.222.0.16 () {54 vars in 961 bytes} [Thu Mar 10 17:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:19:08.004422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92516f69-28aa-4afe-aed9-6f9bd7ebc5e5 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:08.004710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92516f69-28aa-4afe-aed9-6f9bd7ebc5e5 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:08.004988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92516f69-28aa-4afe-aed9-6f9bd7ebc5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:08.022599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-92516f69-28aa-4afe-aed9-6f9bd7ebc5e5 None None] MFA Rules not processed for user `ad9a11df2d3d4dc292a5115de69bb288`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:19:08.023764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-92516f69-28aa-4afe-aed9-6f9bd7ebc5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:19:08.030639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 726/1477] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Mar 10 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:19:08.037542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a88f8-8538-4468-a6c9-0821dcfe533e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:19:08.048759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a88f8-8538-4468-a6c9-0821dcfe533e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:19:08.052273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e47a1-0997-4528-8deb-247dffae02f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9a11df2d3d4dc292a5115de69bb288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:19:08.052897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e47a1-0997-4528-8deb-247dffae02f4 service glance] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:08.053182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e47a1-0997-4528-8deb-247dffae02f4 service glance] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:08.053463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e47a1-0997-4528-8deb-247dffae02f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:08.062170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e47a1-0997-4528-8deb-247dffae02f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:19:08.063760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e47a1-0997-4528-8deb-247dffae02f4 service glance] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:19:08.075731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 752/1478] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:19:10.432616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a2b5c-e45c-4690-8124-f65663772d60 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:10.433173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a2b5c-e45c-4690-8124-f65663772d60 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:10.433173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a2b5c-e45c-4690-8124-f65663772d60 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:10.435496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 727/1479] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:19:10.440529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bbf05-e683-4308-8ee1-4dcb3ae88e47 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:10.440928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bbf05-e683-4308-8ee1-4dcb3ae88e47 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:10.441092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bbf05-e683-4308-8ee1-4dcb3ae88e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:10.459079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8c6bbf05-e683-4308-8ee1-4dcb3ae88e47 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:19:10.460252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8c6bbf05-e683-4308-8ee1-4dcb3ae88e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:19:10.469476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 753/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:19:10.492478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a2b5c-e45c-4690-8124-f65663772d60 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:19:10.505265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a2b5c-e45c-4690-8124-f65663772d60 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:19:10.509649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a4f1b-587f-4108-afed-78ce0ca4c41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:19:10.510316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a4f1b-587f-4108-afed-78ce0ca4c41a admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:10.510598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a4f1b-587f-4108-afed-78ce0ca4c41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:10.510871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a4f1b-587f-4108-afed-78ce0ca4c41a admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:10.511599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a4f1b-587f-4108-afed-78ce0ca4c41a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:19:10.513287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING py.warnings [None req-ba1a4f1b-587f-4108-afed-78ce0ca4c41a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:19:10.513287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: warnings.warn(msg) Mar 10 17:19:10.513287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: Mar 10 17:19:10.514440 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a4f1b-587f-4108-afed-78ce0ca4c41a admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:19:10.532510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 728/1481] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Mar 10 17:19:10 2022] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:19:12.800886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5083e3-d97f-420f-9dea-0243ef8c646f None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:12.801445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5083e3-d97f-420f-9dea-0243ef8c646f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:12.801445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5083e3-d97f-420f-9dea-0243ef8c646f None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:12.803221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 754/1482] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:19:12.808472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b037128-086c-44da-a661-6a0ae9fc2ca0 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:12.808915 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b037128-086c-44da-a661-6a0ae9fc2ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:12.809021 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b037128-086c-44da-a661-6a0ae9fc2ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:12.826870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-0b037128-086c-44da-a661-6a0ae9fc2ca0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:19:12.828031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0b037128-086c-44da-a661-6a0ae9fc2ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:19:12.835523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 729/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:19:12.878045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5083e3-d97f-420f-9dea-0243ef8c646f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:19:12.891883 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5083e3-d97f-420f-9dea-0243ef8c646f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:19:12.897226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcbe9f-6f2f-4e84-993a-b4453e5633f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:19:12.897857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcbe9f-6f2f-4e84-993a-b4453e5633f8 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:12.898169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcbe9f-6f2f-4e84-993a-b4453e5633f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:12.898453 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcbe9f-6f2f-4e84-993a-b4453e5633f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:12.906251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcbe9f-6f2f-4e84-993a-b4453e5633f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:19:12.907811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcbe9f-6f2f-4e84-993a-b4453e5633f8 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:19:12.917078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 755/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:19:15.369271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147402b9-b1bd-477c-8ff1-cb07ed138249 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:15.369808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147402b9-b1bd-477c-8ff1-cb07ed138249 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:15.369808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147402b9-b1bd-477c-8ff1-cb07ed138249 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:15.371722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 730/1485] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:19:15.376988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5153ee-95af-4cd4-9278-983cdd0ce2c0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:15.377421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5153ee-95af-4cd4-9278-983cdd0ce2c0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:15.377572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5153ee-95af-4cd4-9278-983cdd0ce2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:15.394744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9c5153ee-95af-4cd4-9278-983cdd0ce2c0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:19:15.395913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9c5153ee-95af-4cd4-9278-983cdd0ce2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:19:15.404030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 756/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:19:15.439146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147402b9-b1bd-477c-8ff1-cb07ed138249 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:19:15.449646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147402b9-b1bd-477c-8ff1-cb07ed138249 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:19:15.453121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daea43-8ada-4cbb-947f-394498f1cc2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:19:15.453743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daea43-8ada-4cbb-947f-394498f1cc2a service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:15.454023 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daea43-8ada-4cbb-947f-394498f1cc2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:15.454331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daea43-8ada-4cbb-947f-394498f1cc2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:15.462941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daea43-8ada-4cbb-947f-394498f1cc2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:19:15.464348 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daea43-8ada-4cbb-947f-394498f1cc2a service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:19:15.473891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 731/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:19:17.831836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280a666-4a68-459e-b4ba-ec54ae72e1ed None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:17.832341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280a666-4a68-459e-b4ba-ec54ae72e1ed None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:17.832341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280a666-4a68-459e-b4ba-ec54ae72e1ed None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:17.834159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 757/1488] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:19:17.839336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45e15c-ef7f-45f4-9083-2589568a92c8 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:17.839763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45e15c-ef7f-45f4-9083-2589568a92c8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:17.839903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45e15c-ef7f-45f4-9083-2589568a92c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:17.857721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-8d45e15c-ef7f-45f4-9083-2589568a92c8 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:19:17.858972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8d45e15c-ef7f-45f4-9083-2589568a92c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:19:17.867044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 732/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:19:17.904172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280a666-4a68-459e-b4ba-ec54ae72e1ed None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:19:17.914766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280a666-4a68-459e-b4ba-ec54ae72e1ed None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:19:17.918205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93cc06-abbe-4a01-a6a8-cdad91c8a335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:19:17.918860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93cc06-abbe-4a01-a6a8-cdad91c8a335 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:17.919143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93cc06-abbe-4a01-a6a8-cdad91c8a335 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:17.919417 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93cc06-abbe-4a01-a6a8-cdad91c8a335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:17.928416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93cc06-abbe-4a01-a6a8-cdad91c8a335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:19:17.929831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93cc06-abbe-4a01-a6a8-cdad91c8a335 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:19:17.939651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 758/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:19:20.371879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb70bb-9034-4553-bc52-d3bd4d5c1233 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:20.372415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb70bb-9034-4553-bc52-d3bd4d5c1233 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:20.372505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb70bb-9034-4553-bc52-d3bd4d5c1233 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:20.374299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 733/1491] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:19:20.379325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd83c-ad45-47ab-93fe-4cc546a56331 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:20.379755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd83c-ad45-47ab-93fe-4cc546a56331 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:20.379885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd83c-ad45-47ab-93fe-4cc546a56331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:20.397984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-3b5bd83c-ad45-47ab-93fe-4cc546a56331 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:19:20.399199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3b5bd83c-ad45-47ab-93fe-4cc546a56331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:19:20.407831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 759/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:19:20.447520 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb70bb-9034-4553-bc52-d3bd4d5c1233 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:19:20.458470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb70bb-9034-4553-bc52-d3bd4d5c1233 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:19:20.461911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a496e8-14fa-43e6-9b9d-cbc7c8c55114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:19:20.462576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a496e8-14fa-43e6-9b9d-cbc7c8c55114 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:20.462859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a496e8-14fa-43e6-9b9d-cbc7c8c55114 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:20.463135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a496e8-14fa-43e6-9b9d-cbc7c8c55114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:20.472197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a496e8-14fa-43e6-9b9d-cbc7c8c55114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:19:20.473611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a496e8-14fa-43e6-9b9d-cbc7c8c55114 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:19:20.483032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 734/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:19:22.911986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484bf69-85e2-4d12-a490-c7484c81dd74 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:22.912541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484bf69-85e2-4d12-a490-c7484c81dd74 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:22.912541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484bf69-85e2-4d12-a490-c7484c81dd74 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:22.914724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 760/1494] 10.222.0.16 () {54 vars in 926 bytes} [Thu Mar 10 17:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:19:22.920563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd797328-975d-4c80-afcc-294433a6eeea None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:22.920987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd797328-975d-4c80-afcc-294433a6eeea None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:22.921116 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd797328-975d-4c80-afcc-294433a6eeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:22.939146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-fd797328-975d-4c80-afcc-294433a6eeea None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:19:22.940319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fd797328-975d-4c80-afcc-294433a6eeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:19:22.948382 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 735/1495] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Mar 10 17:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:19:22.986327 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484bf69-85e2-4d12-a490-c7484c81dd74 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:19:22.996743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484bf69-85e2-4d12-a490-c7484c81dd74 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:19:23.000732 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1afe35-328a-4d6e-9a99-37d8b768f743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:19:23.001363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1afe35-328a-4d6e-9a99-37d8b768f743 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:19:23.001645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1afe35-328a-4d6e-9a99-37d8b768f743 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:19:23.001920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1afe35-328a-4d6e-9a99-37d8b768f743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:19:23.010744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1afe35-328a-4d6e-9a99-37d8b768f743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:19:23.012201 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1afe35-328a-4d6e-9a99-37d8b768f743 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:19:23.022090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 761/1496] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:20:47.386191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d69dc-19c0-437b-af63-1b997ec821a4 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.386763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d69dc-19c0-437b-af63-1b997ec821a4 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.386763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d69dc-19c0-437b-af63-1b997ec821a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.404592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d12d69dc-19c0-437b-af63-1b997ec821a4 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:20:47.405773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d12d69dc-19c0-437b-af63-1b997ec821a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:20:47.413802 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 736/1497] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:20:47.423399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fcc66-84c6-4075-b07e-d735e9616e39 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.423872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fcc66-84c6-4075-b07e-d735e9616e39 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.423972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fcc66-84c6-4075-b07e-d735e9616e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.442182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-516fcc66-84c6-4075-b07e-d735e9616e39 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:20:47.443370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-516fcc66-84c6-4075-b07e-d735e9616e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:20:47.451131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 762/1498] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:20:47.455808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d69dc-19c0-437b-af63-1b997ec821a4 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:47.465825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d69dc-19c0-437b-af63-1b997ec821a4 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:47.470670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:47.471313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.471592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.471863 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.472768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:20:47.473074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:47.474078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING py.warnings [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:20:47.474078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: warnings.warn(msg) Mar 10 17:20:47.474078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: Mar 10 17:20:47.475185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:47.487095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 737/1499] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:20:47.495383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fcc66-84c6-4075-b07e-d735e9616e39 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:47.505082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fcc66-84c6-4075-b07e-d735e9616e39 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:47.509726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a54d3-b6aa-4731-b312-c2055f3823d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:47.510462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a54d3-b6aa-4731-b312-c2055f3823d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.510751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a54d3-b6aa-4731-b312-c2055f3823d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.511028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a54d3-b6aa-4731-b312-c2055f3823d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.511715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a54d3-b6aa-4731-b312-c2055f3823d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:47.512725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING py.warnings [None req-287a54d3-b6aa-4731-b312-c2055f3823d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:20:47.512725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: warnings.warn(msg) Mar 10 17:20:47.512725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: Mar 10 17:20:47.513909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a54d3-b6aa-4731-b312-c2055f3823d0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:47.549986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 763/1500] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:20:47 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:20:47.554097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:47.563615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a081ec-4b6c-40ec-a159-d69b8eef2c28 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:47.615992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d9d7d-8495-4356-ac7a-d02c6f8fda3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:47.616647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d9d7d-8495-4356-ac7a-d02c6f8fda3e admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.616924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d9d7d-8495-4356-ac7a-d02c6f8fda3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.617195 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d9d7d-8495-4356-ac7a-d02c6f8fda3e admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.617865 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d9d7d-8495-4356-ac7a-d02c6f8fda3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:47.618908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING py.warnings [None req-200d9d7d-8495-4356-ac7a-d02c6f8fda3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:20:47.618908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: warnings.warn(msg) Mar 10 17:20:47.618908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: Mar 10 17:20:47.620105 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d9d7d-8495-4356-ac7a-d02c6f8fda3e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:47.639085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 738/1501] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:20:47 2022] POST /identity/v3/users => generated 290 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:20:47.643489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a54d3-b6aa-4731-b312-c2055f3823d0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:47.653949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a54d3-b6aa-4731-b312-c2055f3823d0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:47.658390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90937-24c4-4501-9e03-527847693b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:47.659043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90937-24c4-4501-9e03-527847693b6b admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.659326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90937-24c4-4501-9e03-527847693b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.659600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90937-24c4-4501-9e03-527847693b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.660310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f90937-24c4-4501-9e03-527847693b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:47.661316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING py.warnings [None req-31f90937-24c4-4501-9e03-527847693b6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:20:47.661316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: warnings.warn(msg) Mar 10 17:20:47.661316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: Mar 10 17:20:47.662220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f90937-24c4-4501-9e03-527847693b6b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:47.675788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 764/1502] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:20:47.679878 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d9d7d-8495-4356-ac7a-d02c6f8fda3e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:47.689338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d9d7d-8495-4356-ac7a-d02c6f8fda3e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:47.693764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f042cc-43f8-4b15-a805-d7f9eaf09ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:47.694441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f042cc-43f8-4b15-a805-d7f9eaf09ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.694725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f042cc-43f8-4b15-a805-d7f9eaf09ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.694998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f042cc-43f8-4b15-a805-d7f9eaf09ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.695715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f042cc-43f8-4b15-a805-d7f9eaf09ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:47.696771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING py.warnings [None req-18f042cc-43f8-4b15-a805-d7f9eaf09ed8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:20:47.696771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: warnings.warn(msg) Mar 10 17:20:47.696771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: Mar 10 17:20:47.697637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f042cc-43f8-4b15-a805-d7f9eaf09ed8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:47.711651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 739/1503] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:20:47.716154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90937-24c4-4501-9e03-527847693b6b admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:47.725530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90937-24c4-4501-9e03-527847693b6b admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:47.729898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a482765-c5c7-47be-8241-2038800de5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:47.731388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a482765-c5c7-47be-8241-2038800de5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.731670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a482765-c5c7-47be-8241-2038800de5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.731942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a482765-c5c7-47be-8241-2038800de5a9 admin admin] PATH_INFO: `/v3/projects/e8c561cdee8d45f494c45e4ced5bbf8d/users/e43f1fcf8a2d4f20ae78b4a6d7c8b2af/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.746369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a482765-c5c7-47be-8241-2038800de5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c561cdee8d45f494c45e4ced5bbf8d, user_id=e43f1fcf8a2d4f20ae78b4a6d7c8b2af, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:47.747393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING py.warnings [None req-4a482765-c5c7-47be-8241-2038800de5a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:20:47.747393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: warnings.warn(msg) Mar 10 17:20:47.747393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: Mar 10 17:20:47.749284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a482765-c5c7-47be-8241-2038800de5a9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:47.762461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 765/1504] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:20:47 2022] PUT /identity/v3/projects/e8c561cdee8d45f494c45e4ced5bbf8d/users/e43f1fcf8a2d4f20ae78b4a6d7c8b2af/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:20:47.773319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b20dc-ead1-4ebe-857d-e698f1eb4516 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.773618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b20dc-ead1-4ebe-857d-e698f1eb4516 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.773897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b20dc-ead1-4ebe-857d-e698f1eb4516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.800357 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-054b20dc-ead1-4ebe-857d-e698f1eb4516 None None] MFA Rules not processed for user `e43f1fcf8a2d4f20ae78b4a6d7c8b2af`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:20:47.801549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-054b20dc-ead1-4ebe-857d-e698f1eb4516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:20:47.863496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 740/1505] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:20:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:20:47.874608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a482765-c5c7-47be-8241-2038800de5a9 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:47.940676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a482765-c5c7-47be-8241-2038800de5a9 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:47.946069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643962d-b131-4f3b-92ea-62272f402f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:47.946737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643962d-b131-4f3b-92ea-62272f402f48 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:47.947023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643962d-b131-4f3b-92ea-62272f402f48 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:47.947303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643962d-b131-4f3b-92ea-62272f402f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:47.955263 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643962d-b131-4f3b-92ea-62272f402f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:47.956833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643962d-b131-4f3b-92ea-62272f402f48 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:47.965802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 766/1506] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:20:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:20:48.038671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753eff1-7f0d-42af-991f-bc3333e4c633 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:48.038965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753eff1-7f0d-42af-991f-bc3333e4c633 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:48.039242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753eff1-7f0d-42af-991f-bc3333e4c633 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:48.040957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 741/1507] 10.222.0.16 () {52 vars in 829 bytes} [Thu Mar 10 17:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:20:48.044506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643962d-b131-4f3b-92ea-62272f402f48 service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:48.102638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643962d-b131-4f3b-92ea-62272f402f48 service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:48.107056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:48.107913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:48.108189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:48.108461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] PATH_INFO: `/v3/users/e43f1fcf8a2d4f20ae78b4a6d7c8b2af` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:48.109613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43f1fcf8a2d4f20ae78b4a6d7c8b2af)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:48.110641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING py.warnings [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:20:48.110641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: warnings.warn(msg) Mar 10 17:20:48.110641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: Mar 10 17:20:48.111821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:48.173574 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43f1fcf8a2d4f20ae78b4a6d7c8b2af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.185308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43f1fcf8a2d4f20ae78b4a6d7c8b2af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.194413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43f1fcf8a2d4f20ae78b4a6d7c8b2af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.195171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43f1fcf8a2d4f20ae78b4a6d7c8b2af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.195785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43f1fcf8a2d4f20ae78b4a6d7c8b2af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.219212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 767/1508] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:20:48 2022] DELETE /identity/v3/users/e43f1fcf8a2d4f20ae78b4a6d7c8b2af => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:20:48.223642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cd925-9778-46fe-9e77-290ae45c33b0 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:48.223935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cd925-9778-46fe-9e77-290ae45c33b0 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:48.224215 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cd925-9778-46fe-9e77-290ae45c33b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:48.241134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-427cd925-9778-46fe-9e77-290ae45c33b0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:20:48.242336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-427cd925-9778-46fe-9e77-290ae45c33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:20:48.296977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 742/1509] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:20:48.307438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:48.309342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:20:48.365434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55996012-89ff-46a7-b99d-62a7081996a1 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:48.368921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a2f2b-260c-43c1-a2bf-a0395fa25d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:48.369564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2f2b-260c-43c1-a2bf-a0395fa25d10 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:48.369866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2f2b-260c-43c1-a2bf-a0395fa25d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:48.370175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2f2b-260c-43c1-a2bf-a0395fa25d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:48.379268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a2f2b-260c-43c1-a2bf-a0395fa25d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:48.380688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a2f2b-260c-43c1-a2bf-a0395fa25d10 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:48.390418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 768/1510] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:20:48.723100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cd925-9778-46fe-9e77-290ae45c33b0 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:20:48.724593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-427cd925-9778-46fe-9e77-290ae45c33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:20:48.736747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cd925-9778-46fe-9e77-290ae45c33b0 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:20:48.743169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:20:48.744019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:20:48.744300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:20:48.744570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] PATH_INFO: `/v3/projects/e8c561cdee8d45f494c45e4ced5bbf8d` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:20:48.746403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c561cdee8d45f494c45e4ced5bbf8d)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:20:48.747420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING py.warnings [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:20:48.747420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: warnings.warn(msg) Mar 10 17:20:48.747420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: Mar 10 17:20:48.748757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:20:48.812718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c561cdee8d45f494c45e4ced5bbf8d', 'request_id': 'req-706be398-2146-4e7d-aca6-ac4512d6fc25'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.825785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c561cdee8d45f494c45e4ced5bbf8d', 'request_id': 'req-706be398-2146-4e7d-aca6-ac4512d6fc25'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.836259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c561cdee8d45f494c45e4ced5bbf8d', 'request_id': 'req-706be398-2146-4e7d-aca6-ac4512d6fc25'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.846997 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] The token cache is being invalidate because project e8c561cdee8d45f494c45e4ced5bbf8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:20:48.847290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.848147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-706be398-2146-4e7d-aca6-ac4512d6fc25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:20:48.850183 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 743/1511] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:20:48 2022] DELETE /identity/v3/projects/e8c561cdee8d45f494c45e4ced5bbf8d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:22:22.512474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff7a11-183b-4656-b522-1b4fe6f67ce3 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:22.513065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff7a11-183b-4656-b522-1b4fe6f67ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:22.513065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff7a11-183b-4656-b522-1b4fe6f67ce3 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:22.514826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 769/1512] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:22:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:22.519646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3f9e-0e71-4f74-88a8-63c8ab15e643 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:22.520048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3f9e-0e71-4f74-88a8-63c8ab15e643 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:22.520207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3f9e-0e71-4f74-88a8-63c8ab15e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:22.538047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ca5c3f9e-0e71-4f74-88a8-63c8ab15e643 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:22.539235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ca5c3f9e-0e71-4f74-88a8-63c8ab15e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:22.594403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 744/1513] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:22:22.746157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff7a11-183b-4656-b522-1b4fe6f67ce3 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:22:22.747811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-72ff7a11-183b-4656-b522-1b4fe6f67ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:22.824120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff7a11-183b-4656-b522-1b4fe6f67ce3 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:22:22.829549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae4723-bfdf-4494-91b2-89f8c5213563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:22:22.830234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae4723-bfdf-4494-91b2-89f8c5213563 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:22.830520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae4723-bfdf-4494-91b2-89f8c5213563 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:22.830798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae4723-bfdf-4494-91b2-89f8c5213563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:22.839903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae4723-bfdf-4494-91b2-89f8c5213563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:22:22.841403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae4723-bfdf-4494-91b2-89f8c5213563 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:22:22.851125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 770/1514] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:22:23.259720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32be381-6302-49fd-9ecc-118939e32ff8 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:23.260022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32be381-6302-49fd-9ecc-118939e32ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:23.260306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32be381-6302-49fd-9ecc-118939e32ff8 None None] PATH_INFO: `/v3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:23.261649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 745/1515] 10.222.0.37 () {54 vars in 925 bytes} [Thu Mar 10 17:22:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:22:23.267705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fc89f-5920-4c93-af11-e647a41b1b92 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:23.267998 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fc89f-5920-4c93-af11-e647a41b1b92 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:23.268280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fc89f-5920-4c93-af11-e647a41b1b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:23.286168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f67fc89f-5920-4c93-af11-e647a41b1b92 None None] MFA Rules not processed for user `a35ae873d42b490cae4dd610f2ac6a60`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:23.287616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f67fc89f-5920-4c93-af11-e647a41b1b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:23.350441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 771/1516] 10.222.0.37 () {58 vars in 1015 bytes} [Thu Mar 10 17:22:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:22:24.122287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734c1f4-82aa-46ff-8eff-ab45f50b2cbc None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:24.122848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734c1f4-82aa-46ff-8eff-ab45f50b2cbc None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:24.122848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734c1f4-82aa-46ff-8eff-ab45f50b2cbc None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:24.124649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 746/1517] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:24.129508 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec95545-a367-4b07-b998-65e586b4ef0f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:24.129913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec95545-a367-4b07-b998-65e586b4ef0f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:24.130065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec95545-a367-4b07-b998-65e586b4ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:24.147547 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-2ec95545-a367-4b07-b998-65e586b4ef0f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:24.148728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2ec95545-a367-4b07-b998-65e586b4ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:24.156401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 772/1518] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:22:24.307100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734c1f4-82aa-46ff-8eff-ab45f50b2cbc None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:22:24.321191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734c1f4-82aa-46ff-8eff-ab45f50b2cbc None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:22:24.326458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a168ff-2845-47b6-b44d-d9b59fffc731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:22:24.327085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a168ff-2845-47b6-b44d-d9b59fffc731 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:24.327369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a168ff-2845-47b6-b44d-d9b59fffc731 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:24.327646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a168ff-2845-47b6-b44d-d9b59fffc731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:24.335450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a168ff-2845-47b6-b44d-d9b59fffc731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:22:24.337035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a168ff-2845-47b6-b44d-d9b59fffc731 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:22:24.349972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 747/1519] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:22:32.573443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3a59-0cac-4c5b-89ea-49e46da4e8b5 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:32.574043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3a59-0cac-4c5b-89ea-49e46da4e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:32.574043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3a59-0cac-4c5b-89ea-49e46da4e8b5 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:32.575816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 773/1520] 10.222.0.16 () {54 vars in 960 bytes} [Thu Mar 10 17:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:32.580907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ad3a-06e8-4b69-86ce-2d03a1bd5028 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:32.581337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ad3a-06e8-4b69-86ce-2d03a1bd5028 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:32.581468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ad3a-06e8-4b69-86ce-2d03a1bd5028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:32.599528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9bb4ad3a-06e8-4b69-86ce-2d03a1bd5028 None None] MFA Rules not processed for user `a35ae873d42b490cae4dd610f2ac6a60`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:32.600827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9bb4ad3a-06e8-4b69-86ce-2d03a1bd5028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:32.609706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 748/1521] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Mar 10 17:22:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:22:32.616866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee3a59-0cac-4c5b-89ea-49e46da4e8b5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:22:32.629661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee3a59-0cac-4c5b-89ea-49e46da4e8b5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:22:32.634539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711a539-e4b9-46bf-b365-8575a89dc331 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35ae873d42b490cae4dd610f2ac6a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:22:32.635153 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711a539-e4b9-46bf-b365-8575a89dc331 service placement] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:32.635435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711a539-e4b9-46bf-b365-8575a89dc331 service placement] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:32.635709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711a539-e4b9-46bf-b365-8575a89dc331 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:32.643694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711a539-e4b9-46bf-b365-8575a89dc331 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:22:32.645259 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711a539-e4b9-46bf-b365-8575a89dc331 service placement] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:22:32.654995 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 774/1522] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:22:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:22:36.027333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83023c8c-33cc-4101-a7c2-d1f831136afc None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:36.027910 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83023c8c-33cc-4101-a7c2-d1f831136afc None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:36.027910 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83023c8c-33cc-4101-a7c2-d1f831136afc None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:36.029638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 749/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:36.034432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047eb94-7c61-4bd2-800a-ec5932852e9c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:36.034831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047eb94-7c61-4bd2-800a-ec5932852e9c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:36.035098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047eb94-7c61-4bd2-800a-ec5932852e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:36.053630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4047eb94-7c61-4bd2-800a-ec5932852e9c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:36.054842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4047eb94-7c61-4bd2-800a-ec5932852e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:36.063008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 775/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:22:36.215478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83023c8c-33cc-4101-a7c2-d1f831136afc None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:22:36.229381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83023c8c-33cc-4101-a7c2-d1f831136afc None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:22:36.234683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41008703-8dc4-47b7-b30b-7cbf36d27774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:22:36.235308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41008703-8dc4-47b7-b30b-7cbf36d27774 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:36.235590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41008703-8dc4-47b7-b30b-7cbf36d27774 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:36.235867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41008703-8dc4-47b7-b30b-7cbf36d27774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:36.243644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41008703-8dc4-47b7-b30b-7cbf36d27774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:22:36.245712 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41008703-8dc4-47b7-b30b-7cbf36d27774 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:22:36.254808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 750/1525] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:22:37.510216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334c2e-7dcd-426f-acc5-96647f3b4ce5 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:37.511306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334c2e-7dcd-426f-acc5-96647f3b4ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:37.511306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334c2e-7dcd-426f-acc5-96647f3b4ce5 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:37.513074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 776/1526] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 17:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:37.518101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a0d6-192e-4cdc-a93e-09aaa0c6ac6e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:37.518496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a0d6-192e-4cdc-a93e-09aaa0c6ac6e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:37.518698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a0d6-192e-4cdc-a93e-09aaa0c6ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:37.537259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-afd9a0d6-192e-4cdc-a93e-09aaa0c6ac6e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:37.538495 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-afd9a0d6-192e-4cdc-a93e-09aaa0c6ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:37.546200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 751/1527] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 17:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:22:37.696906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8334c2e-7dcd-426f-acc5-96647f3b4ce5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:22:37.711722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8334c2e-7dcd-426f-acc5-96647f3b4ce5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:22:37.717564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c7853-48b3-474d-9829-23ebbe901141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:22:37.718221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7853-48b3-474d-9829-23ebbe901141 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:37.718508 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7853-48b3-474d-9829-23ebbe901141 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:37.718783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7853-48b3-474d-9829-23ebbe901141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:37.726497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c7853-48b3-474d-9829-23ebbe901141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:22:37.728075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c7853-48b3-474d-9829-23ebbe901141 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:22:37.737061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 777/1528] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:22:41.990310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27933f88-7632-45d7-bd10-6466d9225bad None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:41.990869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27933f88-7632-45d7-bd10-6466d9225bad None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:41.990869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27933f88-7632-45d7-bd10-6466d9225bad None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:41.992626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 752/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:41.998414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4a2a9-7443-42d2-9998-6ad724ecd2eb None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:41.998843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4a2a9-7443-42d2-9998-6ad724ecd2eb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:41.998969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4a2a9-7443-42d2-9998-6ad724ecd2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:42.016699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-66f4a2a9-7443-42d2-9998-6ad724ecd2eb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:42.017902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-66f4a2a9-7443-42d2-9998-6ad724ecd2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:42.025691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 778/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:22:42.063010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27933f88-7632-45d7-bd10-6466d9225bad None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:22:42.064673 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-27933f88-7632-45d7-bd10-6466d9225bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:42.121343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27933f88-7632-45d7-bd10-6466d9225bad None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:22:42.124858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99793bfc-2092-4e19-9406-4b2aaacce81a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:22:42.125489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793bfc-2092-4e19-9406-4b2aaacce81a service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:42.125772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793bfc-2092-4e19-9406-4b2aaacce81a service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:42.126050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793bfc-2092-4e19-9406-4b2aaacce81a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:42.134692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99793bfc-2092-4e19-9406-4b2aaacce81a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:22:42.136136 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99793bfc-2092-4e19-9406-4b2aaacce81a service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:22:42.145137 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 753/1531] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:22:44.418992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32744b2f-3738-4cbf-ac51-ac6aeb16a409 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:44.419543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32744b2f-3738-4cbf-ac51-ac6aeb16a409 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:44.419543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32744b2f-3738-4cbf-ac51-ac6aeb16a409 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:44.421293 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 779/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:44.426737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606056-0450-4f0b-9c0e-2eea0f4a18eb None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:44.427177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606056-0450-4f0b-9c0e-2eea0f4a18eb None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:44.427293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606056-0450-4f0b-9c0e-2eea0f4a18eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:44.444859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-7c606056-0450-4f0b-9c0e-2eea0f4a18eb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:44.446035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7c606056-0450-4f0b-9c0e-2eea0f4a18eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:44.454671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 754/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:22:44.489975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32744b2f-3738-4cbf-ac51-ac6aeb16a409 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:22:44.500870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32744b2f-3738-4cbf-ac51-ac6aeb16a409 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:22:44.504345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b60f0-a877-4737-83ea-5e1840b3de28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:22:44.504971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b60f0-a877-4737-83ea-5e1840b3de28 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:44.505255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b60f0-a877-4737-83ea-5e1840b3de28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:44.505532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b60f0-a877-4737-83ea-5e1840b3de28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:44.514641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b60f0-a877-4737-83ea-5e1840b3de28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:22:44.516047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b60f0-a877-4737-83ea-5e1840b3de28 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:22:44.525006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 780/1534] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:22:48.375716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49a853-7620-4500-80cf-d110b1ef7f86 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:48.376259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49a853-7620-4500-80cf-d110b1ef7f86 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:48.376259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49a853-7620-4500-80cf-d110b1ef7f86 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:48.378051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 755/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:48.383075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f0e13-d46e-4672-badb-c126110f1a44 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:48.383541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f0e13-d46e-4672-badb-c126110f1a44 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:48.383660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f0e13-d46e-4672-badb-c126110f1a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:48.401852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-7b7f0e13-d46e-4672-badb-c126110f1a44 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:48.403062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7b7f0e13-d46e-4672-badb-c126110f1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:48.410827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 781/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:22:48.664216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49a853-7620-4500-80cf-d110b1ef7f86 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:22:48.665874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cb49a853-7620-4500-80cf-d110b1ef7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:48.722564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49a853-7620-4500-80cf-d110b1ef7f86 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:22:48.726046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd449-e9da-406b-a19d-45b3904a9119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:22:48.726712 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd449-e9da-406b-a19d-45b3904a9119 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:48.726997 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd449-e9da-406b-a19d-45b3904a9119 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:48.727273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd449-e9da-406b-a19d-45b3904a9119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:48.735876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd449-e9da-406b-a19d-45b3904a9119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:22:48.737295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd449-e9da-406b-a19d-45b3904a9119 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:22:48.746378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 756/1537] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:22:51.080593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53b2a-d902-42cc-a42b-2912c5c95824 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:51.081156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53b2a-d902-42cc-a42b-2912c5c95824 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:51.081156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53b2a-d902-42cc-a42b-2912c5c95824 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:51.082953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 782/1538] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 17:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:51.087978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4d49-706d-49e1-afb2-3b2d7c1983ea None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:51.088355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4d49-706d-49e1-afb2-3b2d7c1983ea None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:51.089085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4d49-706d-49e1-afb2-3b2d7c1983ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:51.107217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b46b4d49-706d-49e1-afb2-3b2d7c1983ea None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:51.108391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b46b4d49-706d-49e1-afb2-3b2d7c1983ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:51.115981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 757/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 17:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:22:51.367553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0032b8a-dbd9-4f6d-b7cf-4ea1c53fcc2d None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:51.367845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0032b8a-dbd9-4f6d-b7cf-4ea1c53fcc2d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:51.368127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0032b8a-dbd9-4f6d-b7cf-4ea1c53fcc2d None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:51.369919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 783/1540] 10.222.0.16 () {54 vars in 963 bytes} [Thu Mar 10 17:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:22:51.374858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b1dfc-5f06-4f14-b545-9bcda04e9572 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:51.375152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b1dfc-5f06-4f14-b545-9bcda04e9572 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:51.375435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b1dfc-5f06-4f14-b545-9bcda04e9572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:51.393428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d38b1dfc-5f06-4f14-b545-9bcda04e9572 None None] MFA Rules not processed for user `9f582002cd7141428072dacd218dbe86`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:22:51.394627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d38b1dfc-5f06-4f14-b545-9bcda04e9572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:22:51.400890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 758/1541] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Mar 10 17:22:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:22:51.410531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0032b8a-dbd9-4f6d-b7cf-4ea1c53fcc2d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:22:51.421154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0032b8a-dbd9-4f6d-b7cf-4ea1c53fcc2d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:22:51.424651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833697a-d098-4497-aab9-b54c0a21cc09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:22:51.425275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833697a-d098-4497-aab9-b54c0a21cc09 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:22:51.425559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833697a-d098-4497-aab9-b54c0a21cc09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:22:51.425837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833697a-d098-4497-aab9-b54c0a21cc09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:22:51.434427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833697a-d098-4497-aab9-b54c0a21cc09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:22:51.435837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833697a-d098-4497-aab9-b54c0a21cc09 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:22:51.444900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 784/1542] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:20.296385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd58bb9-758f-48d0-af9b-55c6c5549ab7 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.297127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd58bb9-758f-48d0-af9b-55c6c5549ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.297127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd58bb9-758f-48d0-af9b-55c6c5549ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.332075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bfd58bb9-758f-48d0-af9b-55c6c5549ab7 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.333397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bfd58bb9-758f-48d0-af9b-55c6c5549ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.349000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 759/1543] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.359756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1943a4-953e-491e-849d-e541345e5ab0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.360314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1943a4-953e-491e-849d-e541345e5ab0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.360314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1943a4-953e-491e-849d-e541345e5ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.392314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0f1943a4-953e-491e-849d-e541345e5ab0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.393666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0f1943a4-953e-491e-849d-e541345e5ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.408902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 785/1544] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.414779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd58bb9-758f-48d0-af9b-55c6c5549ab7 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.433170 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd58bb9-758f-48d0-af9b-55c6c5549ab7 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.442778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686c65a-1698-41a7-b617-4e744bc65425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:20.443475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686c65a-1698-41a7-b617-4e744bc65425 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.443772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686c65a-1698-41a7-b617-4e744bc65425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.444054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686c65a-1698-41a7-b617-4e744bc65425 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.444805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686c65a-1698-41a7-b617-4e744bc65425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:20.445160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686c65a-1698-41a7-b617-4e744bc65425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:20.446898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686c65a-1698-41a7-b617-4e744bc65425 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:20.447940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf091e15-733c-4a4e-ac92-307397212f46 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.448764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf091e15-733c-4a4e-ac92-307397212f46 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.449055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf091e15-733c-4a4e-ac92-307397212f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.468950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 760/1545] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:20.470496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2d296-8dbb-4855-89d5-fa4a423e16a7 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.470791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2d296-8dbb-4855-89d5-fa4a423e16a7 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.471070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2d296-8dbb-4855-89d5-fa4a423e16a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.478883 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-cf091e15-733c-4a4e-ac92-307397212f46 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.480539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-cf091e15-733c-4a4e-ac92-307397212f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.493118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 786/1546] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:24:20.494045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf091e15-733c-4a4e-ac92-307397212f46 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.503976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf091e15-733c-4a4e-ac92-307397212f46 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.511279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-eab2d296-8dbb-4855-89d5-fa4a423e16a7 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.512512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-eab2d296-8dbb-4855-89d5-fa4a423e16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.514561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0b0a0-6f39-40b1-abb1-dc768389d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:20.515260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0b0a0-6f39-40b1-abb1-dc768389d0ae admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.515551 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0b0a0-6f39-40b1-abb1-dc768389d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.515833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0b0a0-6f39-40b1-abb1-dc768389d0ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.516633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0b0a0-6f39-40b1-abb1-dc768389d0ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:20.518596 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0b0a0-6f39-40b1-abb1-dc768389d0ae admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:20.536866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 761/1547] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.538516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26a64f-ac5f-4772-8048-bf928bd08239 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.538812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26a64f-ac5f-4772-8048-bf928bd08239 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.539127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26a64f-ac5f-4772-8048-bf928bd08239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.564226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 787/1548] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:20.565407 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6face8-a5db-4a48-913b-b039dd13e467 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.565764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6face8-a5db-4a48-913b-b039dd13e467 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.566165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6face8-a5db-4a48-913b-b039dd13e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.587073 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-da26a64f-ac5f-4772-8048-bf928bd08239 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.588023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8f6face8-a5db-4a48-913b-b039dd13e467 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.588304 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-da26a64f-ac5f-4772-8048-bf928bd08239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.589370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8f6face8-a5db-4a48-913b-b039dd13e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.654241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 788/1549] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.655534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01cc0-fc3c-488a-9da8-ce4258badbcb None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.655835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01cc0-fc3c-488a-9da8-ce4258badbcb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.656112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01cc0-fc3c-488a-9da8-ce4258badbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.669867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 762/1550] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.673695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cce23b-ce0c-4afd-86d2-dcbcdce9e410 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.673695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cce23b-ce0c-4afd-86d2-dcbcdce9e410 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.673695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cce23b-ce0c-4afd-86d2-dcbcdce9e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.675179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d0e01cc0-fc3c-488a-9da8-ce4258badbcb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.676318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d0e01cc0-fc3c-488a-9da8-ce4258badbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.684400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 789/1551] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.685122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e01cc0-fc3c-488a-9da8-ce4258badbcb None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.693659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-16cce23b-ce0c-4afd-86d2-dcbcdce9e410 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.694896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e01cc0-fc3c-488a-9da8-ce4258badbcb None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.695635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-16cce23b-ce0c-4afd-86d2-dcbcdce9e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.703427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f90fb4-9c5b-40b9-b1a3-dd0ea8212022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:20.704102 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f90fb4-9c5b-40b9-b1a3-dd0ea8212022 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.704406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f90fb4-9c5b-40b9-b1a3-dd0ea8212022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.704689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f90fb4-9c5b-40b9-b1a3-dd0ea8212022 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.705703 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f90fb4-9c5b-40b9-b1a3-dd0ea8212022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:20.706331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 763/1552] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.706867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING py.warnings [None req-20f90fb4-9c5b-40b9-b1a3-dd0ea8212022 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:24:20.706867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: warnings.warn(msg) Mar 10 17:24:20.706867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: Mar 10 17:24:20.708127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f90fb4-9c5b-40b9-b1a3-dd0ea8212022 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:20.708866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1a0cc-e636-47b6-b90f-2f429103d24d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.709162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1a0cc-e636-47b6-b90f-2f429103d24d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.715488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1a0cc-e636-47b6-b90f-2f429103d24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.730458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 790/1553] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:20.731654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7a4b-7227-4e90-88b4-1d631a002479 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.731924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-03a1a0cc-e636-47b6-b90f-2f429103d24d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.732061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7a4b-7227-4e90-88b4-1d631a002479 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.732250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7a4b-7227-4e90-88b4-1d631a002479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.733235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-03a1a0cc-e636-47b6-b90f-2f429103d24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.741041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 764/1554] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.742314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1856d-bc4a-4082-91e4-8add7a012fb5 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.742603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1856d-bc4a-4082-91e4-8add7a012fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.742881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1856d-bc4a-4082-91e4-8add7a012fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.749946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9e4a7a4b-7227-4e90-88b4-1d631a002479 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.751194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9e4a7a4b-7227-4e90-88b4-1d631a002479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.759528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 791/1555] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.760441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a7a4b-7227-4e90-88b4-1d631a002479 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.761202 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9db1856d-bc4a-4082-91e4-8add7a012fb5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.762382 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9db1856d-bc4a-4082-91e4-8add7a012fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.769631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a7a4b-7227-4e90-88b4-1d631a002479 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.770871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 765/1556] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.772084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3df43-f48c-4f25-8c66-c828d280b93d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.772370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3df43-f48c-4f25-8c66-c828d280b93d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.772642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3df43-f48c-4f25-8c66-c828d280b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.775106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:20.775755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.776040 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.776319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.777036 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:20.777345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:20.778388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING py.warnings [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:24:20.778388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: warnings.warn(msg) Mar 10 17:24:20.778388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: Mar 10 17:24:20.779295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:20.791304 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 792/1557] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:20.792092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-43e3df43-f48c-4f25-8c66-c828d280b93d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.792222 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.793291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-43e3df43-f48c-4f25-8c66-c828d280b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.807738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 766/1558] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.807738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24490cbd-5bc2-490e-8744-ca97d323d933 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.808019 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba432-96f1-4a4a-9a1a-a993033a63cb admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.808111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24490cbd-5bc2-490e-8744-ca97d323d933 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.808111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24490cbd-5bc2-490e-8744-ca97d323d933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.810442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f781f-0b47-407a-9e0d-b1499a377e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:20.811089 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f781f-0b47-407a-9e0d-b1499a377e96 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.811376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f781f-0b47-407a-9e0d-b1499a377e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.811656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f781f-0b47-407a-9e0d-b1499a377e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.812366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f781f-0b47-407a-9e0d-b1499a377e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:20.812701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f781f-0b47-407a-9e0d-b1499a377e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:20.814345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f781f-0b47-407a-9e0d-b1499a377e96 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:20.823862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-24490cbd-5bc2-490e-8744-ca97d323d933 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.825032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-24490cbd-5bc2-490e-8744-ca97d323d933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.826396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 793/1559] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:20.827182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f781f-0b47-407a-9e0d-b1499a377e96 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.833080 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 767/1560] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.834317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac253c5c-5446-4c5e-badc-21ad71e8e7c3 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.834605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac253c5c-5446-4c5e-badc-21ad71e8e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.834882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac253c5c-5446-4c5e-badc-21ad71e8e7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.838009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f781f-0b47-407a-9e0d-b1499a377e96 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.842603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6535c-cef4-4556-81b4-6662704285a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:20.843262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6535c-cef4-4556-81b4-6662704285a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.843543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6535c-cef4-4556-81b4-6662704285a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.843869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6535c-cef4-4556-81b4-6662704285a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.844583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6535c-cef4-4556-81b4-6662704285a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:20.846209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6535c-cef4-4556-81b4-6662704285a5 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:20.854785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ac253c5c-5446-4c5e-badc-21ad71e8e7c3 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.856826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ac253c5c-5446-4c5e-badc-21ad71e8e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.857462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 794/1561] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:20.859278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864820c3-6d8d-468d-842e-6926b587a9f7 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.859817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864820c3-6d8d-468d-842e-6926b587a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.860104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864820c3-6d8d-468d-842e-6926b587a9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.866879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 768/1562] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.868105 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac253c5c-5446-4c5e-badc-21ad71e8e7c3 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.877190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac253c5c-5446-4c5e-badc-21ad71e8e7c3 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.881581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729535c-f5e9-4dbb-9ce9-253b1965afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:20.882246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729535c-f5e9-4dbb-9ce9-253b1965afd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.882528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729535c-f5e9-4dbb-9ce9-253b1965afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.883366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729535c-f5e9-4dbb-9ce9-253b1965afd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.883528 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-864820c3-6d8d-468d-842e-6926b587a9f7 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.884077 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729535c-f5e9-4dbb-9ce9-253b1965afd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:20.884379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729535c-f5e9-4dbb-9ce9-253b1965afd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:20.884715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-864820c3-6d8d-468d-842e-6926b587a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.886009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729535c-f5e9-4dbb-9ce9-253b1965afd8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:20.892530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 795/1563] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:20.893343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864820c3-6d8d-468d-842e-6926b587a9f7 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.900982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 769/1564] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:20.901661 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729535c-f5e9-4dbb-9ce9-253b1965afd8 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.902650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864820c3-6d8d-468d-842e-6926b587a9f7 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.907877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf583963-0dc5-4d8d-a3aa-c998e0212b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:20.908541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf583963-0dc5-4d8d-a3aa-c998e0212b0d admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.908826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf583963-0dc5-4d8d-a3aa-c998e0212b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.909104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf583963-0dc5-4d8d-a3aa-c998e0212b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.910053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf583963-0dc5-4d8d-a3aa-c998e0212b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:20.910956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729535c-f5e9-4dbb-9ce9-253b1965afd8 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.911980 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf583963-0dc5-4d8d-a3aa-c998e0212b0d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:20.915794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc35c79-7a29-43bd-84c6-9dae850be272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:20.916442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc35c79-7a29-43bd-84c6-9dae850be272 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.916730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc35c79-7a29-43bd-84c6-9dae850be272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.917011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc35c79-7a29-43bd-84c6-9dae850be272 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.917723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc35c79-7a29-43bd-84c6-9dae850be272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:20.918031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc35c79-7a29-43bd-84c6-9dae850be272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:20.919693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc35c79-7a29-43bd-84c6-9dae850be272 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:20.932316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 770/1565] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:20.933210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc35c79-7a29-43bd-84c6-9dae850be272 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:20.940206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 796/1566] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:20.941707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31261-a86c-458c-9d45-31d6393c559a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:20.942001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31261-a86c-458c-9d45-31d6393c559a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:20.942316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31261-a86c-458c-9d45-31d6393c559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:20.946626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc35c79-7a29-43bd-84c6-9dae850be272 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:20.960114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c4b31261-a86c-458c-9d45-31d6393c559a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:20.961338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c4b31261-a86c-458c-9d45-31d6393c559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:20.999607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5707a-6510-4f72-b140-5285ac166a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.000267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5707a-6510-4f72-b140-5285ac166a2c admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.000552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5707a-6510-4f72-b140-5285ac166a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.000828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5707a-6510-4f72-b140-5285ac166a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.001512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5707a-6510-4f72-b140-5285ac166a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.002557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING py.warnings [None req-b8d5707a-6510-4f72-b140-5285ac166a2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:24:21.002557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: warnings.warn(msg) Mar 10 17:24:21.002557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: Mar 10 17:24:21.003741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5707a-6510-4f72-b140-5285ac166a2c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.018084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 797/1567] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:21.018934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b31261-a86c-458c-9d45-31d6393c559a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.028482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b31261-a86c-458c-9d45-31d6393c559a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.032541 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 771/1568] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:20 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.032917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939f2b5-da49-4d64-bd20-39c08a6bde6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.033568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939f2b5-da49-4d64-bd20-39c08a6bde6c admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.033848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939f2b5-da49-4d64-bd20-39c08a6bde6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.034138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939f2b5-da49-4d64-bd20-39c08a6bde6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.034354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5707a-6510-4f72-b140-5285ac166a2c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.035124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939f2b5-da49-4d64-bd20-39c08a6bde6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.036700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939f2b5-da49-4d64-bd20-39c08a6bde6c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.049292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 798/1569] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.049292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939f2b5-da49-4d64-bd20-39c08a6bde6c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.056697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939f2b5-da49-4d64-bd20-39c08a6bde6c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.094398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5707a-6510-4f72-b140-5285ac166a2c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.098937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4766cc-ffb1-4071-8cc7-210e53590275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.099651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4766cc-ffb1-4071-8cc7-210e53590275 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.099963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4766cc-ffb1-4071-8cc7-210e53590275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.100240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4766cc-ffb1-4071-8cc7-210e53590275 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.100951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4766cc-ffb1-4071-8cc7-210e53590275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:21.101372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4766cc-ffb1-4071-8cc7-210e53590275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.103010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4766cc-ffb1-4071-8cc7-210e53590275 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.109324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285e6d9-af1c-41f6-83c4-e8d570272be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.109971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285e6d9-af1c-41f6-83c4-e8d570272be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.110290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285e6d9-af1c-41f6-83c4-e8d570272be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.110568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285e6d9-af1c-41f6-83c4-e8d570272be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.111279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285e6d9-af1c-41f6-83c4-e8d570272be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:21.111582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285e6d9-af1c-41f6-83c4-e8d570272be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.113141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285e6d9-af1c-41f6-83c4-e8d570272be9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.114151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 772/1570] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:21.119030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4766cc-ffb1-4071-8cc7-210e53590275 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.124778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 799/1571] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:21.125542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285e6d9-af1c-41f6-83c4-e8d570272be9 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.129011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4766cc-ffb1-4071-8cc7-210e53590275 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.134488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300e3ec-8eb4-4307-ad73-1bfd26861807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.135103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285e6d9-af1c-41f6-83c4-e8d570272be9 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.135349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300e3ec-8eb4-4307-ad73-1bfd26861807 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.135736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300e3ec-8eb4-4307-ad73-1bfd26861807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.136020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300e3ec-8eb4-4307-ad73-1bfd26861807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.136709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300e3ec-8eb4-4307-ad73-1bfd26861807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.138659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300e3ec-8eb4-4307-ad73-1bfd26861807 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.139749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14021a-5e33-4264-9b76-3207e5f9aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.140372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14021a-5e33-4264-9b76-3207e5f9aeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.140655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14021a-5e33-4264-9b76-3207e5f9aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.140929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14021a-5e33-4264-9b76-3207e5f9aeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.141601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14021a-5e33-4264-9b76-3207e5f9aeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.143481 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14021a-5e33-4264-9b76-3207e5f9aeb8 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.164530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 773/1572] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.165548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300e3ec-8eb4-4307-ad73-1bfd26861807 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.174250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 800/1573] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.174250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14021a-5e33-4264-9b76-3207e5f9aeb8 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.231908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300e3ec-8eb4-4307-ad73-1bfd26861807 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.236577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80388a6f-d168-449b-9ee5-e6c626f21317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.236757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14021a-5e33-4264-9b76-3207e5f9aeb8 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.237242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388a6f-d168-449b-9ee5-e6c626f21317 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.237526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388a6f-d168-449b-9ee5-e6c626f21317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.237805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388a6f-d168-449b-9ee5-e6c626f21317 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.238522 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80388a6f-d168-449b-9ee5-e6c626f21317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.240445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80388a6f-d168-449b-9ee5-e6c626f21317 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.241609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2e338-8e1a-4865-93e1-719c92a34fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.242924 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2e338-8e1a-4865-93e1-719c92a34fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.243207 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2e338-8e1a-4865-93e1-719c92a34fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.243483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2e338-8e1a-4865-93e1-719c92a34fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.244199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2e338-8e1a-4865-93e1-719c92a34fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:21.244501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2e338-8e1a-4865-93e1-719c92a34fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.246299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2e338-8e1a-4865-93e1-719c92a34fe9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.258501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 801/1574] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:21.259274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2e338-8e1a-4865-93e1-719c92a34fe9 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.263177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 774/1575] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/users => generated 279 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.263177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80388a6f-d168-449b-9ee5-e6c626f21317 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.268439 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2e338-8e1a-4865-93e1-719c92a34fe9 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.272732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80388a6f-d168-449b-9ee5-e6c626f21317 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.272853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3778baa-44aa-489c-9768-2274dce635ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.273558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3778baa-44aa-489c-9768-2274dce635ae admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.273942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3778baa-44aa-489c-9768-2274dce635ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.274268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3778baa-44aa-489c-9768-2274dce635ae admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.274943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3778baa-44aa-489c-9768-2274dce635ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.276844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3778baa-44aa-489c-9768-2274dce635ae admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.277306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93589bf7-037d-42d8-a291-2628b5093114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.278200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589bf7-037d-42d8-a291-2628b5093114 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.278487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589bf7-037d-42d8-a291-2628b5093114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.278764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589bf7-037d-42d8-a291-2628b5093114 admin admin] PATH_INFO: `/v3/projects/762f71d88b01442aa0e3d21d90acb912/users/620bbdabce684b3cae72074f54db7fe2/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.294616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589bf7-037d-42d8-a291-2628b5093114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762f71d88b01442aa0e3d21d90acb912, user_id=620bbdabce684b3cae72074f54db7fe2, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.295655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING py.warnings [None req-93589bf7-037d-42d8-a291-2628b5093114 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:24:21.295655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: warnings.warn(msg) Mar 10 17:24:21.295655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: Mar 10 17:24:21.297774 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589bf7-037d-42d8-a291-2628b5093114 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.298564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 802/1576] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/users => generated 303 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.299348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3778baa-44aa-489c-9768-2274dce635ae admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.311296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3778baa-44aa-489c-9768-2274dce635ae admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.314006 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 775/1577] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:21 2022] PUT /identity/v3/projects/762f71d88b01442aa0e3d21d90acb912/users/620bbdabce684b3cae72074f54db7fe2/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:21.318973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93589bf7-037d-42d8-a291-2628b5093114 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.370851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d6918-d90e-4d2e-900b-9e2ca676caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.371431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d6918-d90e-4d2e-900b-9e2ca676caa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.371711 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d6918-d90e-4d2e-900b-9e2ca676caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.371981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d6918-d90e-4d2e-900b-9e2ca676caa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.372659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d6918-d90e-4d2e-900b-9e2ca676caa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.374584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d6918-d90e-4d2e-900b-9e2ca676caa7 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.386281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93589bf7-037d-42d8-a291-2628b5093114 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.390888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806b1a-7fe8-483c-acab-079683bb8d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.391540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806b1a-7fe8-483c-acab-079683bb8d1f admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.391827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806b1a-7fe8-483c-acab-079683bb8d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.392100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806b1a-7fe8-483c-acab-079683bb8d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.392778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc806b1a-7fe8-483c-acab-079683bb8d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.394733 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc806b1a-7fe8-483c-acab-079683bb8d1f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.398414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 803/1578] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.399199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d6918-d90e-4d2e-900b-9e2ca676caa7 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.426252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 776/1579] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.426252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806b1a-7fe8-483c-acab-079683bb8d1f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.459115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d6918-d90e-4d2e-900b-9e2ca676caa7 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.483083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806b1a-7fe8-483c-acab-079683bb8d1f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.487807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb17dd-8755-4a37-a956-20cbaad86b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.488484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb17dd-8755-4a37-a956-20cbaad86b23 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.490664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb17dd-8755-4a37-a956-20cbaad86b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.490664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb17dd-8755-4a37-a956-20cbaad86b23 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.491332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb17dd-8755-4a37-a956-20cbaad86b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.495942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb17dd-8755-4a37-a956-20cbaad86b23 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.516313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 777/1580] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.517369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb17dd-8755-4a37-a956-20cbaad86b23 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.520068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a6ec1-509b-4fcc-ad04-4e1f6acedcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.520757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a6ec1-509b-4fcc-ad04-4e1f6acedcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.521044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a6ec1-509b-4fcc-ad04-4e1f6acedcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.521343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a6ec1-509b-4fcc-ad04-4e1f6acedcb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.522019 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a6ec1-509b-4fcc-ad04-4e1f6acedcb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.524013 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a6ec1-509b-4fcc-ad04-4e1f6acedcb4 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.528835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb17dd-8755-4a37-a956-20cbaad86b23 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.533660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016a487-c616-4501-bf36-59e6f0a81296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.534425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016a487-c616-4501-bf36-59e6f0a81296 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.534987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016a487-c616-4501-bf36-59e6f0a81296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.535256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016a487-c616-4501-bf36-59e6f0a81296 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.536000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016a487-c616-4501-bf36-59e6f0a81296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.537921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016a487-c616-4501-bf36-59e6f0a81296 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.544258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 804/1581] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.545058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a6ec1-509b-4fcc-ad04-4e1f6acedcb4 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.554246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a6ec1-509b-4fcc-ad04-4e1f6acedcb4 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.559911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949ed0-5ae1-4b7c-baa8-eb343b2a991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.560596 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949ed0-5ae1-4b7c-baa8-eb343b2a991c admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.560864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949ed0-5ae1-4b7c-baa8-eb343b2a991c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.561139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949ed0-5ae1-4b7c-baa8-eb343b2a991c admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.561852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949ed0-5ae1-4b7c-baa8-eb343b2a991c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.563464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949ed0-5ae1-4b7c-baa8-eb343b2a991c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.566098 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 778/1582] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.567062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016a487-c616-4501-bf36-59e6f0a81296 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.573239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 805/1583] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.574339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ca728-c6e8-48ba-9d9d-a7bc48532fe8 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.574631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ca728-c6e8-48ba-9d9d-a7bc48532fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.574906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ca728-c6e8-48ba-9d9d-a7bc48532fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.600493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-155ca728-c6e8-48ba-9d9d-a7bc48532fe8 None None] MFA Rules not processed for user `620bbdabce684b3cae72074f54db7fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:21.602295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-155ca728-c6e8-48ba-9d9d-a7bc48532fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:21.627995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016a487-c616-4501-bf36-59e6f0a81296 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.632729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77086a6a-fa74-4e7e-830c-b18fae050399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.633395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77086a6a-fa74-4e7e-830c-b18fae050399 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.633681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77086a6a-fa74-4e7e-830c-b18fae050399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.633960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77086a6a-fa74-4e7e-830c-b18fae050399 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.634715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77086a6a-fa74-4e7e-830c-b18fae050399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.636301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77086a6a-fa74-4e7e-830c-b18fae050399 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.646072 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 779/1584] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.646072 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77086a6a-fa74-4e7e-830c-b18fae050399 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.657328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77086a6a-fa74-4e7e-830c-b18fae050399 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.662132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c8b3-c994-4597-9f6d-31e7288d98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.662864 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c8b3-c994-4597-9f6d-31e7288d98b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.663156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c8b3-c994-4597-9f6d-31e7288d98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.663437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c8b3-c994-4597-9f6d-31e7288d98b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.664704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c8b3-c994-4597-9f6d-31e7288d98b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.666638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c8b3-c994-4597-9f6d-31e7288d98b4 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.669245 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 806/1585] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:21.669867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ca728-c6e8-48ba-9d9d-a7bc48532fe8 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.681717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ca728-c6e8-48ba-9d9d-a7bc48532fe8 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.686361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc173d-1845-4181-9690-f6fa1bca6896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.686941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 780/1586] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.687054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc173d-1845-4181-9690-f6fa1bca6896 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.687280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc173d-1845-4181-9690-f6fa1bca6896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.687564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc173d-1845-4181-9690-f6fa1bca6896 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.687813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c8b3-c994-4597-9f6d-31e7288d98b4 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.688244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc173d-1845-4181-9690-f6fa1bca6896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.690341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc173d-1845-4181-9690-f6fa1bca6896 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.697364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c8b3-c994-4597-9f6d-31e7288d98b4 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.702636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc81fd4-b146-4ea4-9415-b2296699fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.703271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc81fd4-b146-4ea4-9415-b2296699fce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.703570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc81fd4-b146-4ea4-9415-b2296699fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.703880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc81fd4-b146-4ea4-9415-b2296699fce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.704621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc81fd4-b146-4ea4-9415-b2296699fce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.706229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc81fd4-b146-4ea4-9415-b2296699fce1 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.712913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 807/1587] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.712913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc173d-1845-4181-9690-f6fa1bca6896 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.719587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 781/1588] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.719587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc81fd4-b146-4ea4-9415-b2296699fce1 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.721182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc173d-1845-4181-9690-f6fa1bca6896 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.727849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc81fd4-b146-4ea4-9415-b2296699fce1 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.728608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66905f1b-645c-4c07-b2fe-a827b74cb6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.729266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66905f1b-645c-4c07-b2fe-a827b74cb6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.729550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66905f1b-645c-4c07-b2fe-a827b74cb6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.729830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66905f1b-645c-4c07-b2fe-a827b74cb6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.730580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66905f1b-645c-4c07-b2fe-a827b74cb6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.732180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66905f1b-645c-4c07-b2fe-a827b74cb6e7 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.732508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554844ae-76fb-4491-92fe-41368b2d5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.733152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554844ae-76fb-4491-92fe-41368b2d5c54 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.733442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554844ae-76fb-4491-92fe-41368b2d5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.733723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554844ae-76fb-4491-92fe-41368b2d5c54 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.734860 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554844ae-76fb-4491-92fe-41368b2d5c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.736437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554844ae-76fb-4491-92fe-41368b2d5c54 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.743078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 808/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.743772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66905f1b-645c-4c07-b2fe-a827b74cb6e7 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.753616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66905f1b-645c-4c07-b2fe-a827b74cb6e7 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.761058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 782/1590] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.761210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb5f6d-b65f-473a-ac89-8acdaa6f9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.761210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb5f6d-b65f-473a-ac89-8acdaa6f9dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.761397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554844ae-76fb-4491-92fe-41368b2d5c54 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.761475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb5f6d-b65f-473a-ac89-8acdaa6f9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.761475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb5f6d-b65f-473a-ac89-8acdaa6f9dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.761475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb5f6d-b65f-473a-ac89-8acdaa6f9dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.761692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb5f6d-b65f-473a-ac89-8acdaa6f9dcd admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.767874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554844ae-76fb-4491-92fe-41368b2d5c54 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.772367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4ddc7-1844-4f5f-aa7d-4caa77aee825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.776135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 809/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.776300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4ddc7-1844-4f5f-aa7d-4caa77aee825 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.776300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4ddc7-1844-4f5f-aa7d-4caa77aee825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.776470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb5f6d-b65f-473a-ac89-8acdaa6f9dcd admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.776558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4ddc7-1844-4f5f-aa7d-4caa77aee825 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.776558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4ddc7-1844-4f5f-aa7d-4caa77aee825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.776558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4ddc7-1844-4f5f-aa7d-4caa77aee825 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.783493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb5f6d-b65f-473a-ac89-8acdaa6f9dcd admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.788404 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 783/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.788601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364508db-9801-460e-819d-f606137d09c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.789228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364508db-9801-460e-819d-f606137d09c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.789509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364508db-9801-460e-819d-f606137d09c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.789779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364508db-9801-460e-819d-f606137d09c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.791010 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364508db-9801-460e-819d-f606137d09c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.793147 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364508db-9801-460e-819d-f606137d09c1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.793341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4ddc7-1844-4f5f-aa7d-4caa77aee825 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.803074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4ddc7-1844-4f5f-aa7d-4caa77aee825 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.807857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c7b9c-7e4a-4b14-a9e7-aec3630257b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.808429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c7b9c-7e4a-4b14-a9e7-aec3630257b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.808819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c7b9c-7e4a-4b14-a9e7-aec3630257b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.809064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c7b9c-7e4a-4b14-a9e7-aec3630257b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.809972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c7b9c-7e4a-4b14-a9e7-aec3630257b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.811791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c7b9c-7e4a-4b14-a9e7-aec3630257b9 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.819107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 810/1593] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:21.819928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364508db-9801-460e-819d-f606137d09c1 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.822274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 784/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.823220 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c7b9c-7e4a-4b14-a9e7-aec3630257b9 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.833653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c7b9c-7e4a-4b14-a9e7-aec3630257b9 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.879135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364508db-9801-460e-819d-f606137d09c1 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.883587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24526f1-d2e2-4dae-a3d1-69f8bf84b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.884248 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24526f1-d2e2-4dae-a3d1-69f8bf84b9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.884525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24526f1-d2e2-4dae-a3d1-69f8bf84b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.884796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24526f1-d2e2-4dae-a3d1-69f8bf84b9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.885509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24526f1-d2e2-4dae-a3d1-69f8bf84b9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.887158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24526f1-d2e2-4dae-a3d1-69f8bf84b9a7 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.888408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e99a7-55a8-4e24-b6a0-6d309c43a2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.889203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e99a7-55a8-4e24-b6a0-6d309c43a2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.889504 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e99a7-55a8-4e24-b6a0-6d309c43a2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.889832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e99a7-55a8-4e24-b6a0-6d309c43a2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.890624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e99a7-55a8-4e24-b6a0-6d309c43a2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.892500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e99a7-55a8-4e24-b6a0-6d309c43a2d7 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.897124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 811/1595] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.899081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24526f1-d2e2-4dae-a3d1-69f8bf84b9a7 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.902532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 785/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.903338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e99a7-55a8-4e24-b6a0-6d309c43a2d7 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.909874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24526f1-d2e2-4dae-a3d1-69f8bf84b9a7 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.913026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e99a7-55a8-4e24-b6a0-6d309c43a2d7 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.915372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc276468-6c8b-440c-8f01-4ec8e3a2a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.916085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc276468-6c8b-440c-8f01-4ec8e3a2a04c admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.916370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc276468-6c8b-440c-8f01-4ec8e3a2a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.916647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc276468-6c8b-440c-8f01-4ec8e3a2a04c admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.917359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc276468-6c8b-440c-8f01-4ec8e3a2a04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.918188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faafc4d-a98e-4917-b8f3-f27c53ee1883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.918823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faafc4d-a98e-4917-b8f3-f27c53ee1883 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.919094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc276468-6c8b-440c-8f01-4ec8e3a2a04c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.919203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faafc4d-a98e-4917-b8f3-f27c53ee1883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.919365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faafc4d-a98e-4917-b8f3-f27c53ee1883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.920071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faafc4d-a98e-4917-b8f3-f27c53ee1883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.921647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faafc4d-a98e-4917-b8f3-f27c53ee1883 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.928772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 812/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.929597 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc276468-6c8b-440c-8f01-4ec8e3a2a04c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.934228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 786/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:21.934228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faafc4d-a98e-4917-b8f3-f27c53ee1883 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.938761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc276468-6c8b-440c-8f01-4ec8e3a2a04c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.943303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e32cb0-89b2-4752-ad9a-7e877d53642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.943452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faafc4d-a98e-4917-b8f3-f27c53ee1883 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:21.944165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e32cb0-89b2-4752-ad9a-7e877d53642d admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.944452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e32cb0-89b2-4752-ad9a-7e877d53642d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.944734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e32cb0-89b2-4752-ad9a-7e877d53642d admin admin] PATH_INFO: `/v3/projects/90ef0bed623b449fb88beea7cb6029a8/users/de406a5b5462463386dafaeee504db0a/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.948146 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a1ee-e132-4358-a0da-db6c6d370544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:21.949028 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a1ee-e132-4358-a0da-db6c6d370544 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:21.949325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a1ee-e132-4358-a0da-db6c6d370544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:21.949576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a1ee-e132-4358-a0da-db6c6d370544 admin admin] PATH_INFO: `/v3/projects/4e6c460df5f9481d9ee6963b5bb88307/users/f6f5ba2f42bc43858620bba1e6d72a30/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:21.958955 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e32cb0-89b2-4752-ad9a-7e877d53642d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ef0bed623b449fb88beea7cb6029a8, user_id=de406a5b5462463386dafaeee504db0a, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.962170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e32cb0-89b2-4752-ad9a-7e877d53642d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.963786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420a1ee-e132-4358-a0da-db6c6d370544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6c460df5f9481d9ee6963b5bb88307, user_id=f6f5ba2f42bc43858620bba1e6d72a30, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:21.966473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420a1ee-e132-4358-a0da-db6c6d370544 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:21.975033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 813/1599] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:21 2022] PUT /identity/v3/projects/90ef0bed623b449fb88beea7cb6029a8/users/de406a5b5462463386dafaeee504db0a/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:21.975789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e32cb0-89b2-4752-ad9a-7e877d53642d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:21.979628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 787/1600] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:21 2022] PUT /identity/v3/projects/4e6c460df5f9481d9ee6963b5bb88307/users/f6f5ba2f42bc43858620bba1e6d72a30/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:21.982972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a1ee-e132-4358-a0da-db6c6d370544 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.040432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a1ee-e132-4358-a0da-db6c6d370544 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.040899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e32cb0-89b2-4752-ad9a-7e877d53642d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.045037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd33c-d401-4d12-8bd0-724392066ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.045413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb97b8-2a4a-4f15-8614-c46056860084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.045702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd33c-d401-4d12-8bd0-724392066ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.045987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd33c-d401-4d12-8bd0-724392066ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.046097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb97b8-2a4a-4f15-8614-c46056860084 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.046297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd33c-d401-4d12-8bd0-724392066ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.046393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb97b8-2a4a-4f15-8614-c46056860084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.046653 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb97b8-2a4a-4f15-8614-c46056860084 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.047014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fd33c-d401-4d12-8bd0-724392066ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.047331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb97b8-2a4a-4f15-8614-c46056860084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.048600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fd33c-d401-4d12-8bd0-724392066ea4 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.049224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb97b8-2a4a-4f15-8614-c46056860084 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.058125 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 788/1601] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:22.059766 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd33c-d401-4d12-8bd0-724392066ea4 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.069265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd33c-d401-4d12-8bd0-724392066ea4 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.069682 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 814/1602] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:21 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:22.071049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb97b8-2a4a-4f15-8614-c46056860084 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.074450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9e30a-3ff6-4fb4-87ac-c326d51e0f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.075097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9e30a-3ff6-4fb4-87ac-c326d51e0f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.075376 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9e30a-3ff6-4fb4-87ac-c326d51e0f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.075652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9e30a-3ff6-4fb4-87ac-c326d51e0f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.076356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9e30a-3ff6-4fb4-87ac-c326d51e0f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.077918 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9e30a-3ff6-4fb4-87ac-c326d51e0f37 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.080385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb97b8-2a4a-4f15-8614-c46056860084 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.084963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25195f68-7730-4710-b77b-3f67a4610584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.086415 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25195f68-7730-4710-b77b-3f67a4610584 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.086718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25195f68-7730-4710-b77b-3f67a4610584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.086985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25195f68-7730-4710-b77b-3f67a4610584 admin admin] PATH_INFO: `/v3/projects/a8035d5a6b58456aa377797f6e11ca52/users/08471b64404b40cfb4307ba74f0a1c6f/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.088214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 789/1603] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:22.089330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9e30a-3ff6-4fb4-87ac-c326d51e0f37 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.099924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9e30a-3ff6-4fb4-87ac-c326d51e0f37 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.101563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25195f68-7730-4710-b77b-3f67a4610584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8035d5a6b58456aa377797f6e11ca52, user_id=08471b64404b40cfb4307ba74f0a1c6f, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.104220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25195f68-7730-4710-b77b-3f67a4610584 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.104634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd78bcd-d60e-4f0c-b837-7d598a57a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.105493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd78bcd-d60e-4f0c-b837-7d598a57a848 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.105771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd78bcd-d60e-4f0c-b837-7d598a57a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.106043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd78bcd-d60e-4f0c-b837-7d598a57a848 admin admin] PATH_INFO: `/v3/projects/0745835d450343598602d04226bc2b72/users/5b1d1b2e34cc4cdda0a7c1bcc6a82a01/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.119272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 815/1604] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:22 2022] PUT /identity/v3/projects/a8035d5a6b58456aa377797f6e11ca52/users/08471b64404b40cfb4307ba74f0a1c6f/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:22.127266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25195f68-7730-4710-b77b-3f67a4610584 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.127383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd78bcd-d60e-4f0c-b837-7d598a57a848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0745835d450343598602d04226bc2b72, user_id=5b1d1b2e34cc4cdda0a7c1bcc6a82a01, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.127383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd78bcd-d60e-4f0c-b837-7d598a57a848 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.139219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 790/1605] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:22 2022] PUT /identity/v3/projects/0745835d450343598602d04226bc2b72/users/5b1d1b2e34cc4cdda0a7c1bcc6a82a01/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:22.140722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746d7f0-874d-4f23-aa1c-deb90e41c49e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.141020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746d7f0-874d-4f23-aa1c-deb90e41c49e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.141302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746d7f0-874d-4f23-aa1c-deb90e41c49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.159994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-c746d7f0-874d-4f23-aa1c-deb90e41c49e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:22.161180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c746d7f0-874d-4f23-aa1c-deb90e41c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.192922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25195f68-7730-4710-b77b-3f67a4610584 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.216895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 791/1606] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:22.218187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49a94-1bae-42a8-b5cc-c548a376bb12 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.218482 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49a94-1bae-42a8-b5cc-c548a376bb12 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.218761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49a94-1bae-42a8-b5cc-c548a376bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.244761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-cee49a94-1bae-42a8-b5cc-c548a376bb12 None None] MFA Rules not processed for user `de406a5b5462463386dafaeee504db0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:22.245968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cee49a94-1bae-42a8-b5cc-c548a376bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.247797 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5789797-defa-4d43-92d1-4ac4a5e27dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.248414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5789797-defa-4d43-92d1-4ac4a5e27dac admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.248695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5789797-defa-4d43-92d1-4ac4a5e27dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.249021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5789797-defa-4d43-92d1-4ac4a5e27dac admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.249740 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5789797-defa-4d43-92d1-4ac4a5e27dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.251382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5789797-defa-4d43-92d1-4ac4a5e27dac admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.261519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 816/1607] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:22.262404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5789797-defa-4d43-92d1-4ac4a5e27dac admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.271099 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5789797-defa-4d43-92d1-4ac4a5e27dac admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.276224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d4b0b-8b69-4ca9-93f8-7f2c9d4919b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.277064 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4b0b-8b69-4ca9-93f8-7f2c9d4919b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.277342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4b0b-8b69-4ca9-93f8-7f2c9d4919b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.277616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4b0b-8b69-4ca9-93f8-7f2c9d4919b3 admin admin] PATH_INFO: `/v3/projects/6eb73c579cdb40bd843d4e19a535f2ae/users/9dbdadbe21e542dcb1c3dad9d67e8a92/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.291967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d4b0b-8b69-4ca9-93f8-7f2c9d4919b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb73c579cdb40bd843d4e19a535f2ae, user_id=9dbdadbe21e542dcb1c3dad9d67e8a92, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.294616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d4b0b-8b69-4ca9-93f8-7f2c9d4919b3 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.308563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 792/1608] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:22.309345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49a94-1bae-42a8-b5cc-c548a376bb12 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.309456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 817/1609] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:22 2022] PUT /identity/v3/projects/6eb73c579cdb40bd843d4e19a535f2ae/users/9dbdadbe21e542dcb1c3dad9d67e8a92/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:22.310253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d4b0b-8b69-4ca9-93f8-7f2c9d4919b3 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.320672 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49a94-1bae-42a8-b5cc-c548a376bb12 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.373761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d4b0b-8b69-4ca9-93f8-7f2c9d4919b3 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.374592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a5529-47cd-4f0f-9650-71948bf831d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.375268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a5529-47cd-4f0f-9650-71948bf831d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.375557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a5529-47cd-4f0f-9650-71948bf831d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.375835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a5529-47cd-4f0f-9650-71948bf831d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.376557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a5529-47cd-4f0f-9650-71948bf831d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.378219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a5529-47cd-4f0f-9650-71948bf831d7 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.378458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5ca76-41c6-4861-bce4-f90141de5833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.379341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ca76-41c6-4861-bce4-f90141de5833 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.379626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ca76-41c6-4861-bce4-f90141de5833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.379903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ca76-41c6-4861-bce4-f90141de5833 admin admin] PATH_INFO: `/v3/projects/af4cd71eec7c4d47a9d7e9cdd65add9a/users/8fe99bd37b184bf3b5e78602ab0073fe/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.388552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 793/1610] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:22.389868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bde95-0d26-4acf-ae92-1b194f455f2a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.390095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bde95-0d26-4acf-ae92-1b194f455f2a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.390399 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bde95-0d26-4acf-ae92-1b194f455f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.395297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5ca76-41c6-4861-bce4-f90141de5833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4cd71eec7c4d47a9d7e9cdd65add9a, user_id=8fe99bd37b184bf3b5e78602ab0073fe, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.398273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5ca76-41c6-4861-bce4-f90141de5833 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.411298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 818/1611] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:22 2022] PUT /identity/v3/projects/af4cd71eec7c4d47a9d7e9cdd65add9a/users/8fe99bd37b184bf3b5e78602ab0073fe/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:22.412606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705188e-76f4-42d7-9ebe-2403c79bba07 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.412900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705188e-76f4-42d7-9ebe-2403c79bba07 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.413180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705188e-76f4-42d7-9ebe-2403c79bba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.416903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-713bde95-0d26-4acf-ae92-1b194f455f2a None None] MFA Rules not processed for user `08471b64404b40cfb4307ba74f0a1c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:22.418130 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-713bde95-0d26-4acf-ae92-1b194f455f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.429931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9705188e-76f4-42d7-9ebe-2403c79bba07 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:22.431160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9705188e-76f4-42d7-9ebe-2403c79bba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.479810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 794/1612] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:22.480652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bde95-0d26-4acf-ae92-1b194f455f2a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.490121 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 819/1613] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:22.490939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705188e-76f4-42d7-9ebe-2403c79bba07 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.506240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705188e-76f4-42d7-9ebe-2403c79bba07 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.511691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd85e42-30e4-40a7-962d-16a55ac72c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.512580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd85e42-30e4-40a7-962d-16a55ac72c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.512868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd85e42-30e4-40a7-962d-16a55ac72c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.513151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd85e42-30e4-40a7-962d-16a55ac72c0c admin admin] PATH_INFO: `/v3/projects/8bfade72cd754d9092d313481b3f465f/users/719425608bc4447ea2f433e12ebbb180/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.528238 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd85e42-30e4-40a7-962d-16a55ac72c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfade72cd754d9092d313481b3f465f, user_id=719425608bc4447ea2f433e12ebbb180, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.531227 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd85e42-30e4-40a7-962d-16a55ac72c0c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.535851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bde95-0d26-4acf-ae92-1b194f455f2a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.539822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf781da7-a25f-44ee-9643-bb04469cdd81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.540467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf781da7-a25f-44ee-9643-bb04469cdd81 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.540750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf781da7-a25f-44ee-9643-bb04469cdd81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.541030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf781da7-a25f-44ee-9643-bb04469cdd81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.544406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 820/1614] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:22 2022] PUT /identity/v3/projects/8bfade72cd754d9092d313481b3f465f/users/719425608bc4447ea2f433e12ebbb180/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:22.545161 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd85e42-30e4-40a7-962d-16a55ac72c0c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.550301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf781da7-a25f-44ee-9643-bb04469cdd81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.551750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf781da7-a25f-44ee-9643-bb04469cdd81 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.561882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 795/1615] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:22.563278 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221e9bd-d2c6-4781-8553-e3af783eff13 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.563573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221e9bd-d2c6-4781-8553-e3af783eff13 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.563975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221e9bd-d2c6-4781-8553-e3af783eff13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.583087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d221e9bd-d2c6-4781-8553-e3af783eff13 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:22.584422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d221e9bd-d2c6-4781-8553-e3af783eff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.608605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd85e42-30e4-40a7-962d-16a55ac72c0c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.613363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2a56-8c10-42a6-a3c5-42f4d8e5aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.614070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2a56-8c10-42a6-a3c5-42f4d8e5aa98 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.614390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2a56-8c10-42a6-a3c5-42f4d8e5aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.614666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2a56-8c10-42a6-a3c5-42f4d8e5aa98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.615353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e2a56-8c10-42a6-a3c5-42f4d8e5aa98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.617853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e2a56-8c10-42a6-a3c5-42f4d8e5aa98 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.644905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 821/1616] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/projects => generated 357 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:22.645677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2a56-8c10-42a6-a3c5-42f4d8e5aa98 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.648849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 796/1617] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:22.650284 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489597e4-7de5-403a-b05b-74c3687fd97d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.650586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489597e4-7de5-403a-b05b-74c3687fd97d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.650864 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489597e4-7de5-403a-b05b-74c3687fd97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.670089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-489597e4-7de5-403a-b05b-74c3687fd97d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:22.671341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-489597e4-7de5-403a-b05b-74c3687fd97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.712014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2a56-8c10-42a6-a3c5-42f4d8e5aa98 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.717485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29d0a7-af9b-4a4d-89ed-dcc27c28e5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.718597 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29d0a7-af9b-4a4d-89ed-dcc27c28e5de admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.718896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29d0a7-af9b-4a4d-89ed-dcc27c28e5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.719158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29d0a7-af9b-4a4d-89ed-dcc27c28e5de admin admin] PATH_INFO: `/v3/projects/093a115dd41549e9b7388d79d9685038/users/546046bd4cde418195822af11f868778/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.738079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 797/1618] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:22.739280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc537c-bf09-4205-9827-62a3a8967f45 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.739602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc537c-bf09-4205-9827-62a3a8967f45 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.739881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc537c-bf09-4205-9827-62a3a8967f45 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.741805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29d0a7-af9b-4a4d-89ed-dcc27c28e5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=093a115dd41549e9b7388d79d9685038, user_id=546046bd4cde418195822af11f868778, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.745069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29d0a7-af9b-4a4d-89ed-dcc27c28e5de admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.749014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 798/1619] 10.222.0.16 () {54 vars in 961 bytes} [Thu Mar 10 17:24:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:24:22.749014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc537c-bf09-4205-9827-62a3a8967f45 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.767386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 822/1620] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:22 2022] PUT /identity/v3/projects/093a115dd41549e9b7388d79d9685038/users/546046bd4cde418195822af11f868778/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:22.768702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c687-1deb-403d-a3cd-020f84c22609 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.768979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c687-1deb-403d-a3cd-020f84c22609 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.769256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c687-1deb-403d-a3cd-020f84c22609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.786650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-3269c687-1deb-403d-a3cd-020f84c22609 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:22.787868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3269c687-1deb-403d-a3cd-020f84c22609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.816711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc537c-bf09-4205-9827-62a3a8967f45 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.852825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 823/1621] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:22.856396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c687-1deb-403d-a3cd-020f84c22609 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.871999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c687-1deb-403d-a3cd-020f84c22609 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.879273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87326719-a046-4b85-89c0-3875c83ed8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.880277 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682621-ceef-4820-a94e-ed3958965963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.880421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87326719-a046-4b85-89c0-3875c83ed8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.881118 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87326719-a046-4b85-89c0-3875c83ed8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.881118 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87326719-a046-4b85-89c0-3875c83ed8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.881297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682621-ceef-4820-a94e-ed3958965963 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.881868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682621-ceef-4820-a94e-ed3958965963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.881868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682621-ceef-4820-a94e-ed3958965963 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.882575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f682621-ceef-4820-a94e-ed3958965963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.884890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f682621-ceef-4820-a94e-ed3958965963 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.892190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87326719-a046-4b85-89c0-3875c83ed8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.893764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87326719-a046-4b85-89c0-3875c83ed8a0 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.904097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 799/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:22.904651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87326719-a046-4b85-89c0-3875c83ed8a0 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.908550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 824/1623] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/users => generated 285 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:22.908714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-87326719-a046-4b85-89c0-3875c83ed8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.908815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682621-ceef-4820-a94e-ed3958965963 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.910238 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6f682621-ceef-4820-a94e-ed3958965963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.919312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87326719-a046-4b85-89c0-3875c83ed8a0 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.921946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682621-ceef-4820-a94e-ed3958965963 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.923116 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2195f3-8e45-4d01-8bcf-ce05db34b301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.923790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2195f3-8e45-4d01-8bcf-ce05db34b301 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.924076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2195f3-8e45-4d01-8bcf-ce05db34b301 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.924353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2195f3-8e45-4d01-8bcf-ce05db34b301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.925810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181128a-9c32-40f1-9b39-5daf6bf8395c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.926479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181128a-9c32-40f1-9b39-5daf6bf8395c service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.926765 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181128a-9c32-40f1-9b39-5daf6bf8395c service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.927042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181128a-9c32-40f1-9b39-5daf6bf8395c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.934446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2195f3-8e45-4d01-8bcf-ce05db34b301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.935972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2195f3-8e45-4d01-8bcf-ce05db34b301 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.937073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181128a-9c32-40f1-9b39-5daf6bf8395c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.938542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181128a-9c32-40f1-9b39-5daf6bf8395c service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:22.945825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 800/1624] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:22.947309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df47ff-fb3b-4e08-9803-9eb78a39668d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.947603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df47ff-fb3b-4e08-9803-9eb78a39668d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.947885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df47ff-fb3b-4e08-9803-9eb78a39668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.950065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 825/1625] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:22.951837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181128a-9c32-40f1-9b39-5daf6bf8395c service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:22.962484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181128a-9c32-40f1-9b39-5daf6bf8395c service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:22.966736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-19df47ff-fb3b-4e08-9803-9eb78a39668d None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:22.968012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-19df47ff-fb3b-4e08-9803-9eb78a39668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:22.968606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ede6-b765-4f0e-b8b1-a85ad46247e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:22.969495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ede6-b765-4f0e-b8b1-a85ad46247e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:22.969983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ede6-b765-4f0e-b8b1-a85ad46247e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:22.970484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ede6-b765-4f0e-b8b1-a85ad46247e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:22.971801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636ede6-b765-4f0e-b8b1-a85ad46247e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:22.974986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636ede6-b765-4f0e-b8b1-a85ad46247e6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.006646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 826/1626] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:23.008715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ede6-b765-4f0e-b8b1-a85ad46247e6 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:23.034957 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ede6-b765-4f0e-b8b1-a85ad46247e6 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:23.045185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a54fa-24d0-4c22-9cdc-b7c191e805ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:23.045886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a54fa-24d0-4c22-9cdc-b7c191e805ff service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.046173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a54fa-24d0-4c22-9cdc-b7c191e805ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.046467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a54fa-24d0-4c22-9cdc-b7c191e805ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.060060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 801/1627] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Mar 10 17:24:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:23.061239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df47ff-fb3b-4e08-9803-9eb78a39668d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:23.071721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a54fa-24d0-4c22-9cdc-b7c191e805ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:23.073689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df47ff-fb3b-4e08-9803-9eb78a39668d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:23.076164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a54fa-24d0-4c22-9cdc-b7c191e805ff service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.080165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4d36-a16d-446d-be7c-14d4d8599fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:23.081274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4d36-a16d-446d-be7c-14d4d8599fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.081681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4d36-a16d-446d-be7c-14d4d8599fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.082270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4d36-a16d-446d-be7c-14d4d8599fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.083548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4d36-a16d-446d-be7c-14d4d8599fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:23.086695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4d36-a16d-446d-be7c-14d4d8599fc1 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.098943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 802/1628] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:23.100266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4d36-a16d-446d-be7c-14d4d8599fc1 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:23.101300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 827/1629] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:23.102939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a54fa-24d0-4c22-9cdc-b7c191e805ff service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:23.114799 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4d36-a16d-446d-be7c-14d4d8599fc1 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:23.121432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb822b51-de0c-4d08-99a2-845031fcdd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:23.122676 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb822b51-de0c-4d08-99a2-845031fcdd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.123144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb822b51-de0c-4d08-99a2-845031fcdd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.123548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb822b51-de0c-4d08-99a2-845031fcdd7d admin admin] PATH_INFO: `/v3/projects/093a115dd41549e9b7388d79d9685038/users/546046bd4cde418195822af11f868778/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.126295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb822b51-de0c-4d08-99a2-845031fcdd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=093a115dd41549e9b7388d79d9685038, user_id=546046bd4cde418195822af11f868778, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:23.129874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb822b51-de0c-4d08-99a2-845031fcdd7d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.130028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a54fa-24d0-4c22-9cdc-b7c191e805ff service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:23.143523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 803/1630] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:23 2022] PUT /identity/v3/projects/093a115dd41549e9b7388d79d9685038/users/546046bd4cde418195822af11f868778/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:23.147325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5341a-caa0-41d2-8482-ffca1cf6b065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:23.148001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5341a-caa0-41d2-8482-ffca1cf6b065 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.148832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5341a-caa0-41d2-8482-ffca1cf6b065 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.149113 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5341a-caa0-41d2-8482-ffca1cf6b065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.153901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb822b51-de0c-4d08-99a2-845031fcdd7d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:23.218804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5341a-caa0-41d2-8482-ffca1cf6b065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:23.221890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5341a-caa0-41d2-8482-ffca1cf6b065 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.237986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 828/1631] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:23.239919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13295a85-02b1-4ac2-8eba-fc8c6bf1b758 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.240206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13295a85-02b1-4ac2-8eba-fc8c6bf1b758 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.240539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13295a85-02b1-4ac2-8eba-fc8c6bf1b758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.240701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb822b51-de0c-4d08-99a2-845031fcdd7d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:23.247558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f513a-4f03-464b-b8be-b75e50f2e16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:23.248545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f513a-4f03-464b-b8be-b75e50f2e16d admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.248885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f513a-4f03-464b-b8be-b75e50f2e16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.249381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f513a-4f03-464b-b8be-b75e50f2e16d admin admin] PATH_INFO: `/v3/projects/95cad6dc5f3a480b9b5ec3be620c01dc/users/3fbff7c4dde8456cb2a5f33defcf8cf4/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.272293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f513a-4f03-464b-b8be-b75e50f2e16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cad6dc5f3a480b9b5ec3be620c01dc, user_id=3fbff7c4dde8456cb2a5f33defcf8cf4, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:23.276752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f513a-4f03-464b-b8be-b75e50f2e16d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.283047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-13295a85-02b1-4ac2-8eba-fc8c6bf1b758 None None] MFA Rules not processed for user `546046bd4cde418195822af11f868778`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:23.286415 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-13295a85-02b1-4ac2-8eba-fc8c6bf1b758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:23.301166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 804/1632] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:23 2022] PUT /identity/v3/projects/95cad6dc5f3a480b9b5ec3be620c01dc/users/3fbff7c4dde8456cb2a5f33defcf8cf4/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:23.307745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f513a-4f03-464b-b8be-b75e50f2e16d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:23.375247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 829/1633] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:23.390657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13295a85-02b1-4ac2-8eba-fc8c6bf1b758 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:23.421656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f513a-4f03-464b-b8be-b75e50f2e16d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:23.427717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893a802-9469-4f49-8987-4e654b9645cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:23.428386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a802-9469-4f49-8987-4e654b9645cd admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.428745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a802-9469-4f49-8987-4e654b9645cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.429117 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a802-9469-4f49-8987-4e654b9645cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.430783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893a802-9469-4f49-8987-4e654b9645cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:23.433491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893a802-9469-4f49-8987-4e654b9645cd admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.445925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 805/1634] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:23.450005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893a802-9469-4f49-8987-4e654b9645cd admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:23.462218 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13295a85-02b1-4ac2-8eba-fc8c6bf1b758 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:23.462685 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893a802-9469-4f49-8987-4e654b9645cd admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:23.468844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31269e66-474c-4569-b603-0d58eb477ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:23.469972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269e66-474c-4569-b603-0d58eb477ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.470361 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269e66-474c-4569-b603-0d58eb477ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.471601 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269e66-474c-4569-b603-0d58eb477ab8 admin admin] PATH_INFO: `/v3/projects/95cad6dc5f3a480b9b5ec3be620c01dc/users/3fbff7c4dde8456cb2a5f33defcf8cf4/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.474593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31269e66-474c-4569-b603-0d58eb477ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cad6dc5f3a480b9b5ec3be620c01dc, user_id=3fbff7c4dde8456cb2a5f33defcf8cf4, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:23.479650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31269e66-474c-4569-b603-0d58eb477ab8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.497319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 806/1635] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:23 2022] PUT /identity/v3/projects/95cad6dc5f3a480b9b5ec3be620c01dc/users/3fbff7c4dde8456cb2a5f33defcf8cf4/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:23.508119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64af69-ef09-4e99-98ec-521482cb078b None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.508450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64af69-ef09-4e99-98ec-521482cb078b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.508786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64af69-ef09-4e99-98ec-521482cb078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.521126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfb395-8411-4bd2-872d-adf58f74d1e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:23.522176 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfb395-8411-4bd2-872d-adf58f74d1e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.522636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfb395-8411-4bd2-872d-adf58f74d1e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.523275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfb395-8411-4bd2-872d-adf58f74d1e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.562115 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9d64af69-ef09-4e99-98ec-521482cb078b None None] MFA Rules not processed for user `3fbff7c4dde8456cb2a5f33defcf8cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:23.563481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9d64af69-ef09-4e99-98ec-521482cb078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:23.641545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfb395-8411-4bd2-872d-adf58f74d1e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:23.642872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfb395-8411-4bd2-872d-adf58f74d1e1 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.669256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 830/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:23.671632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 807/1637] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:23 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:23.685474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfb395-8411-4bd2-872d-adf58f74d1e1 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:23.702906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfb395-8411-4bd2-872d-adf58f74d1e1 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:23.844602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23cc42-281a-4569-99f5-dd41f72709cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:23.846130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23cc42-281a-4569-99f5-dd41f72709cd service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.846490 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23cc42-281a-4569-99f5-dd41f72709cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.847445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23cc42-281a-4569-99f5-dd41f72709cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.880671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23cc42-281a-4569-99f5-dd41f72709cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:23.882170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23cc42-281a-4569-99f5-dd41f72709cd service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:23.914426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 831/1638] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:23 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:23.939220 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f489b6-7f7a-458d-899d-13f49acb83f1 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.939518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f489b6-7f7a-458d-899d-13f49acb83f1 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.939859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f489b6-7f7a-458d-899d-13f49acb83f1 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.941785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 808/1639] 10.222.0.16 () {54 vars in 961 bytes} [Thu Mar 10 17:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:24:23.949274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0551f-8bc2-458f-a8db-cfc3a7e9a71f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:23.949666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0551f-8bc2-458f-a8db-cfc3a7e9a71f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:23.950202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0551f-8bc2-458f-a8db-cfc3a7e9a71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:23.985399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c3e0551f-8bc2-458f-a8db-cfc3a7e9a71f None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:23.986913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c3e0551f-8bc2-458f-a8db-cfc3a7e9a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:24.107535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 832/1640] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Mar 10 17:24:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:24.113260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ed79-fe01-4319-b6a5-ba931c8b2f39 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:24.114626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ed79-fe01-4319-b6a5-ba931c8b2f39 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:24.115162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ed79-fe01-4319-b6a5-ba931c8b2f39 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:24.120033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 809/1641] 10.222.0.16 () {54 vars in 912 bytes} [Thu Mar 10 17:24:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:24:24.142031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507e27c-d044-4e18-9e45-b23781b6a2e5 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:24.142409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507e27c-d044-4e18-9e45-b23781b6a2e5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:24.142636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507e27c-d044-4e18-9e45-b23781b6a2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:24.150939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980ed79-fe01-4319-b6a5-ba931c8b2f39 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:24.188302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c507e27c-d044-4e18-9e45-b23781b6a2e5 None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:24.189561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c507e27c-d044-4e18-9e45-b23781b6a2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:24.212562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 833/1642] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:24:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:24.212562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507e27c-d044-4e18-9e45-b23781b6a2e5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:24.244686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980ed79-fe01-4319-b6a5-ba931c8b2f39 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:24.250910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507e27c-d044-4e18-9e45-b23781b6a2e5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:24.251416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:24.252699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:24.253163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:24.253697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] PATH_INFO: `/v3/users/620bbdabce684b3cae72074f54db7fe2` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:24.255379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620bbdabce684b3cae72074f54db7fe2)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:24.257095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: WARNING py.warnings [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:24:24.257095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: warnings.warn(msg) Mar 10 17:24:24.257095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: Mar 10 17:24:24.258544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787d08d-b2cf-4643-9719-d8b75ef060d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:24.259224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787d08d-b2cf-4643-9719-d8b75ef060d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:24.259515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787d08d-b2cf-4643-9719-d8b75ef060d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:24.260426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:24.264450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787d08d-b2cf-4643-9719-d8b75ef060d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:24.397506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620bbdabce684b3cae72074f54db7fe2'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:24.412562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787d08d-b2cf-4643-9719-d8b75ef060d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:24.415416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787d08d-b2cf-4643-9719-d8b75ef060d0 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:24.421080 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620bbdabce684b3cae72074f54db7fe2'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:24.421456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620bbdabce684b3cae72074f54db7fe2'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:24.457100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620bbdabce684b3cae72074f54db7fe2'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:24.461405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 834/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:24 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:24.463184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9a4ec-d0ff-4659-a11c-d7d2fbf042f9 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:24.471424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9a4ec-d0ff-4659-a11c-d7d2fbf042f9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:24.471757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9a4ec-d0ff-4659-a11c-d7d2fbf042f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:24.493653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620bbdabce684b3cae72074f54db7fe2'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:24.505451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 810/1644] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:24 2022] DELETE /identity/v3/users/620bbdabce684b3cae72074f54db7fe2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:24:24.506691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:24.509096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:24.551124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0cf9a4ec-d0ff-4659-a11c-d7d2fbf042f9 None None] MFA Rules not processed for user `f6f5ba2f42bc43858620bba1e6d72a30`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:24.552502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0cf9a4ec-d0ff-4659-a11c-d7d2fbf042f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:24.577789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44aeb-cb32-4b49-8dd0-3391396def53 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:24.581618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280c727-a829-401c-ae39-8a4130a422ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:24.582309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280c727-a829-401c-ae39-8a4130a422ae service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:24.582594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280c727-a829-401c-ae39-8a4130a422ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:24.583239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280c727-a829-401c-ae39-8a4130a422ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:24.585356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5280c727-a829-401c-ae39-8a4130a422ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:24.682416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280c727-a829-401c-ae39-8a4130a422ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:24.683932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280c727-a829-401c-ae39-8a4130a422ae service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:24.698774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 835/1645] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:24.702475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752fdc2-729c-45b8-b5f6-aeecae156b13 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:24.702712 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752fdc2-729c-45b8-b5f6-aeecae156b13 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:24.703000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752fdc2-729c-45b8-b5f6-aeecae156b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:24.711507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 811/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:24.712844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d34a51-dd84-4841-9a08-015a0b300c86 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:24.713134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d34a51-dd84-4841-9a08-015a0b300c86 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:24.713466 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d34a51-dd84-4841-9a08-015a0b300c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:24.737676 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-20d34a51-dd84-4841-9a08-015a0b300c86 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:24.739498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-20d34a51-dd84-4841-9a08-015a0b300c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:24.758229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8752fdc2-729c-45b8-b5f6-aeecae156b13 None None] MFA Rules not processed for user `5b1d1b2e34cc4cdda0a7c1bcc6a82a01`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:24.760899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8752fdc2-729c-45b8-b5f6-aeecae156b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:24.829974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 812/1647] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:24.829974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d34a51-dd84-4841-9a08-015a0b300c86 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:24.829974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-20d34a51-dd84-4841-9a08-015a0b300c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:24.843212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d34a51-dd84-4841-9a08-015a0b300c86 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:24.849790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e016-4248-4176-a4bf-54bade6ed480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:24.850540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e016-4248-4176-a4bf-54bade6ed480 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:24.850915 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e016-4248-4176-a4bf-54bade6ed480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:24.851281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e016-4248-4176-a4bf-54bade6ed480 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:24.852679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e016-4248-4176-a4bf-54bade6ed480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:24.855644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e016-4248-4176-a4bf-54bade6ed480 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:24.930690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 813/1648] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:24 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:24.930690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e016-4248-4176-a4bf-54bade6ed480 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:24.934345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b4c9e016-4248-4176-a4bf-54bade6ed480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:24.965607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 836/1649] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:24.965853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752fdc2-729c-45b8-b5f6-aeecae156b13 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:25.013006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752fdc2-729c-45b8-b5f6-aeecae156b13 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:25.126090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e016-4248-4176-a4bf-54bade6ed480 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:25.134855 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9fbbb-5736-4cd2-9fa3-f6bd5aa09227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:25.136843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9fbbb-5736-4cd2-9fa3-f6bd5aa09227 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.137478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9fbbb-5736-4cd2-9fa3-f6bd5aa09227 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.137883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9fbbb-5736-4cd2-9fa3-f6bd5aa09227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.143617 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c35ccf-1db6-4fcf-84cb-72f500e7b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:25.144359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c35ccf-1db6-4fcf-84cb-72f500e7b6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.144667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c35ccf-1db6-4fcf-84cb-72f500e7b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.145017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c35ccf-1db6-4fcf-84cb-72f500e7b6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.145778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c35ccf-1db6-4fcf-84cb-72f500e7b6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:25.148508 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c35ccf-1db6-4fcf-84cb-72f500e7b6b7 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:25.156980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9fbbb-5736-4cd2-9fa3-f6bd5aa09227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:25.159105 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9fbbb-5736-4cd2-9fa3-f6bd5aa09227 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:25.172137 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 814/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:25.173374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd630af-cc6f-4375-9e2b-e12bca65f736 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.173669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd630af-cc6f-4375-9e2b-e12bca65f736 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.174192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd630af-cc6f-4375-9e2b-e12bca65f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.192326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 837/1651] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:24 2022] POST /identity/v3/users => generated 309 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:25.194195 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eb7d4-97ce-4ec9-b2c5-1838b4d3a729 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.194694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eb7d4-97ce-4ec9-b2c5-1838b4d3a729 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.195394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eb7d4-97ce-4ec9-b2c5-1838b4d3a729 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.200349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3bd630af-cc6f-4375-9e2b-e12bca65f736 None None] MFA Rules not processed for user `5b1d1b2e34cc4cdda0a7c1bcc6a82a01`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:25.201823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3bd630af-cc6f-4375-9e2b-e12bca65f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:25.206000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 838/1652] 10.222.0.16 () {54 vars in 912 bytes} [Thu Mar 10 17:24:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:24:25.207525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eb7d4-97ce-4ec9-b2c5-1838b4d3a729 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:25.225871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eb7d4-97ce-4ec9-b2c5-1838b4d3a729 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:25.234932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb1bbe-1c95-4b14-8434-4c7068c6f278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:25.236139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb1bbe-1c95-4b14-8434-4c7068c6f278 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.237119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb1bbe-1c95-4b14-8434-4c7068c6f278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.238100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb1bbe-1c95-4b14-8434-4c7068c6f278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.239355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb1bbe-1c95-4b14-8434-4c7068c6f278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:25.243096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb1bbe-1c95-4b14-8434-4c7068c6f278 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:25.270452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 839/1653] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:25.271949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee24ee9-963b-4696-963d-8ea5847f45f1 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.272249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee24ee9-963b-4696-963d-8ea5847f45f1 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.272535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee24ee9-963b-4696-963d-8ea5847f45f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.298258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-3ee24ee9-963b-4696-963d-8ea5847f45f1 None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:25.300608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3ee24ee9-963b-4696-963d-8ea5847f45f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:25.317988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 815/1654] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:25.317988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd630af-cc6f-4375-9e2b-e12bca65f736 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:25.330196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd630af-cc6f-4375-9e2b-e12bca65f736 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:25.336256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11804259-66e7-41ff-a2cb-3b467fb50164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:25.337600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11804259-66e7-41ff-a2cb-3b467fb50164 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.338153 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11804259-66e7-41ff-a2cb-3b467fb50164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.338683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11804259-66e7-41ff-a2cb-3b467fb50164 admin admin] PATH_INFO: `/v3/projects/4931f4b0e7124118b8b187251f64db06/users/8fca30ec1e3e4646991fdbbf9f841495/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.356143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11804259-66e7-41ff-a2cb-3b467fb50164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4931f4b0e7124118b8b187251f64db06, user_id=8fca30ec1e3e4646991fdbbf9f841495, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:25.359437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11804259-66e7-41ff-a2cb-3b467fb50164 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:25.378987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 816/1655] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:25 2022] PUT /identity/v3/projects/4931f4b0e7124118b8b187251f64db06/users/8fca30ec1e3e4646991fdbbf9f841495/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:25.380622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11804259-66e7-41ff-a2cb-3b467fb50164 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:25.383697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-11804259-66e7-41ff-a2cb-3b467fb50164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:25.410182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 840/1656] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:24:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:25.411048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee24ee9-963b-4696-963d-8ea5847f45f1 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:25.422646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee24ee9-963b-4696-963d-8ea5847f45f1 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:25.474946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11804259-66e7-41ff-a2cb-3b467fb50164 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:25.482908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd653e-d8c6-4ed4-99cf-36f9f5e6d88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:25.483873 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd653e-d8c6-4ed4-99cf-36f9f5e6d88c service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.484254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd653e-d8c6-4ed4-99cf-36f9f5e6d88c service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.484599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd653e-d8c6-4ed4-99cf-36f9f5e6d88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.557159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd653e-d8c6-4ed4-99cf-36f9f5e6d88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:25.559082 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd653e-d8c6-4ed4-99cf-36f9f5e6d88c service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:25.573423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 817/1657] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:25.574701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd653e-d8c6-4ed4-99cf-36f9f5e6d88c service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:25.576266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0ecd653e-d8c6-4ed4-99cf-36f9f5e6d88c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:25.626868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922a050-995a-4985-8a8c-f55e13b46521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:25.627861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922a050-995a-4985-8a8c-f55e13b46521 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.628474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922a050-995a-4985-8a8c-f55e13b46521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.628984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922a050-995a-4985-8a8c-f55e13b46521 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.631332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922a050-995a-4985-8a8c-f55e13b46521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:25.634861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922a050-995a-4985-8a8c-f55e13b46521 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:25.642369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd653e-d8c6-4ed4-99cf-36f9f5e6d88c service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:25.646709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e30b4-d489-4867-b04b-1c2295b449aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:25.647443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e30b4-d489-4867-b04b-1c2295b449aa service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.647798 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e30b4-d489-4867-b04b-1c2295b449aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.648686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e30b4-d489-4867-b04b-1c2295b449aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.660480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 841/1658] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:25.661054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e30b4-d489-4867-b04b-1c2295b449aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:25.662771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e30b4-d489-4867-b04b-1c2295b449aa service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:25.664480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922a050-995a-4985-8a8c-f55e13b46521 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:25.676764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 818/1659] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:25.683815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922a050-995a-4985-8a8c-f55e13b46521 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:25.690384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bb438-73d7-4291-8932-fcb67025e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:25.691452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bb438-73d7-4291-8932-fcb67025e6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.691737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bb438-73d7-4291-8932-fcb67025e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.692011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bb438-73d7-4291-8932-fcb67025e6a2 admin admin] PATH_INFO: `/v3/projects/4931f4b0e7124118b8b187251f64db06/users/8fca30ec1e3e4646991fdbbf9f841495/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.694401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bb438-73d7-4291-8932-fcb67025e6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4931f4b0e7124118b8b187251f64db06, user_id=8fca30ec1e3e4646991fdbbf9f841495, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:25.697421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bb438-73d7-4291-8932-fcb67025e6a2 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:25.724164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 842/1660] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:25 2022] PUT /identity/v3/projects/4931f4b0e7124118b8b187251f64db06/users/8fca30ec1e3e4646991fdbbf9f841495/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:25.877061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e30b4-d489-4867-b04b-1c2295b449aa service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:25.879279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3f3e30b4-d489-4867-b04b-1c2295b449aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:25.896294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e30b4-d489-4867-b04b-1c2295b449aa service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:25.977663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:25.978919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:25.979418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:25.979754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] PATH_INFO: `/v3/users/08471b64404b40cfb4307ba74f0a1c6f` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:25.982260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08471b64404b40cfb4307ba74f0a1c6f)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:25.985136 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:26.065665 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08471b64404b40cfb4307ba74f0a1c6f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.109135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08471b64404b40cfb4307ba74f0a1c6f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.110327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08471b64404b40cfb4307ba74f0a1c6f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.126335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08471b64404b40cfb4307ba74f0a1c6f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.168816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08471b64404b40cfb4307ba74f0a1c6f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.181314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 819/1661] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:25 2022] DELETE /identity/v3/users/08471b64404b40cfb4307ba74f0a1c6f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:26.192677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad9b8-6fe2-4fe3-87c5-c558cb3cc791 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:26.194028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad9b8-6fe2-4fe3-87c5-c558cb3cc791 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:26.194603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad9b8-6fe2-4fe3-87c5-c558cb3cc791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:26.236099 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-93aad9b8-6fe2-4fe3-87c5-c558cb3cc791 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:26.237657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-93aad9b8-6fe2-4fe3-87c5-c558cb3cc791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:26.367294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:26.369193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:26.377638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 843/1662] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:26.400778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c710f-9cd3-4caf-ac8e-1db012ca869a admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:26.417715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:26.419050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:26.419585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:26.420570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] PATH_INFO: `/v3/projects/762f71d88b01442aa0e3d21d90acb912` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:26.423117 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=762f71d88b01442aa0e3d21d90acb912)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:26.427079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:26.528899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762f71d88b01442aa0e3d21d90acb912', 'request_id': 'req-b0476ae7-8eae-4b1e-b908-774ad9f92967'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.537365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762f71d88b01442aa0e3d21d90acb912', 'request_id': 'req-b0476ae7-8eae-4b1e-b908-774ad9f92967'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.543352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad9b8-6fe2-4fe3-87c5-c558cb3cc791 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:26.545824 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-93aad9b8-6fe2-4fe3-87c5-c558cb3cc791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:26.553020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762f71d88b01442aa0e3d21d90acb912', 'request_id': 'req-b0476ae7-8eae-4b1e-b908-774ad9f92967'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.569426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] The token cache is being invalidate because project 762f71d88b01442aa0e3d21d90acb912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:26.570039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.571445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.573464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 820/1663] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:26 2022] DELETE /identity/v3/projects/762f71d88b01442aa0e3d21d90acb912 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:24:26.578292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:26.580101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:26.632869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad9b8-6fe2-4fe3-87c5-c558cb3cc791 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:26.674492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0476ae7-8eae-4b1e-b908-774ad9f92967 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:26.681450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:26.682377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:26.682713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:26.683009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] PATH_INFO: `/v3/users/546046bd4cde418195822af11f868778` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:26.684383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546046bd4cde418195822af11f868778)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:26.686422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:26.714395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83ce4-e90c-4f9c-8ddd-29a82b302fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:26.715949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83ce4-e90c-4f9c-8ddd-29a82b302fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:26.716450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83ce4-e90c-4f9c-8ddd-29a82b302fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:26.717000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83ce4-e90c-4f9c-8ddd-29a82b302fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:26.721352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1fa83ce4-e90c-4f9c-8ddd-29a82b302fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:26.748379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546046bd4cde418195822af11f868778'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.751043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa83ce4-e90c-4f9c-8ddd-29a82b302fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:26.755126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa83ce4-e90c-4f9c-8ddd-29a82b302fc2 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:26.760439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546046bd4cde418195822af11f868778'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.762437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546046bd4cde418195822af11f868778'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.773583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546046bd4cde418195822af11f868778'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.782209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 844/1664] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:26.797453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5934703-91f8-41cc-9dd5-8580bb0f3bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546046bd4cde418195822af11f868778'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:26.808078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 821/1665] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:26 2022] DELETE /identity/v3/users/546046bd4cde418195822af11f868778 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:27.047477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13592c9-7694-4aff-bc9f-0660cdca4567 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:27.048722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13592c9-7694-4aff-bc9f-0660cdca4567 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:27.049630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13592c9-7694-4aff-bc9f-0660cdca4567 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:27.053661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 845/1666] 10.222.0.16 () {54 vars in 912 bytes} [Thu Mar 10 17:24:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:24:27.065668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11489-ceb0-4900-a429-21d7973617ec None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:27.070909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11489-ceb0-4900-a429-21d7973617ec None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:27.071678 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11489-ceb0-4900-a429-21d7973617ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:27.173536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-86b11489-ceb0-4900-a429-21d7973617ec None None] MFA Rules not processed for user `701c0e43cc30442582456f4f7153333a`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:27.178234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-86b11489-ceb0-4900-a429-21d7973617ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:27.321359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 822/1667] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:24:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:27.344359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13592c9-7694-4aff-bc9f-0660cdca4567 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:27.346748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a13592c9-7694-4aff-bc9f-0660cdca4567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:27.367681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13592c9-7694-4aff-bc9f-0660cdca4567 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:27.372650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde45bc-449f-4772-b032-3c1ca0154c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:27.373402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde45bc-449f-4772-b032-3c1ca0154c07 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:27.373688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde45bc-449f-4772-b032-3c1ca0154c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:27.373959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde45bc-449f-4772-b032-3c1ca0154c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:27.383066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde45bc-449f-4772-b032-3c1ca0154c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:27.384590 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde45bc-449f-4772-b032-3c1ca0154c07 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:27.397138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 846/1668] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:28.301370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd82b2a-ef6f-4935-b8d7-c9b2fdb24c27 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:28.301896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd82b2a-ef6f-4935-b8d7-c9b2fdb24c27 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:28.301896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd82b2a-ef6f-4935-b8d7-c9b2fdb24c27 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:28.304749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 823/1669] 10.222.0.16 () {54 vars in 960 bytes} [Thu Mar 10 17:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:24:28.309535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071565ce-ebe2-4887-a60d-ce89136c3465 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:28.309963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071565ce-ebe2-4887-a60d-ce89136c3465 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:28.310202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071565ce-ebe2-4887-a60d-ce89136c3465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:28.341699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-071565ce-ebe2-4887-a60d-ce89136c3465 None None] MFA Rules not processed for user `a35ae873d42b490cae4dd610f2ac6a60`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:28.345395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-071565ce-ebe2-4887-a60d-ce89136c3465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:28.480041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd82b2a-ef6f-4935-b8d7-c9b2fdb24c27 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:28.481921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fbd82b2a-ef6f-4935-b8d7-c9b2fdb24c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:28.504613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 847/1670] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Mar 10 17:24:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:28.506494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071565ce-ebe2-4887-a60d-ce89136c3465 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:28.508512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-071565ce-ebe2-4887-a60d-ce89136c3465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:28.624553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071565ce-ebe2-4887-a60d-ce89136c3465 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:28.636743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:28.637744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:28.638122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:28.638493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] PATH_INFO: `/v3/projects/093a115dd41549e9b7388d79d9685038` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:28.639819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=093a115dd41549e9b7388d79d9685038)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:28.641792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: WARNING py.warnings [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 17:24:28.641792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: warnings.warn(msg) Mar 10 17:24:28.641792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: Mar 10 17:24:28.643950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:28.668429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd82b2a-ef6f-4935-b8d7-c9b2fdb24c27 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:28.683164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:28.684296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:28.684733 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:28.685014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] PATH_INFO: `/v3/projects/a8035d5a6b58456aa377797f6e11ca52` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:28.686709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8035d5a6b58456aa377797f6e11ca52)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:28.689860 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:28.767679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093a115dd41549e9b7388d79d9685038', 'request_id': 'req-303a7ca5-e65e-47d3-be50-a4ae552dce13'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.792017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093a115dd41549e9b7388d79d9685038', 'request_id': 'req-303a7ca5-e65e-47d3-be50-a4ae552dce13'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.822607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8035d5a6b58456aa377797f6e11ca52', 'request_id': 'req-ade8d53b-5634-49ed-9a97-94c47e195db7'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.829731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093a115dd41549e9b7388d79d9685038', 'request_id': 'req-303a7ca5-e65e-47d3-be50-a4ae552dce13'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.841880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8035d5a6b58456aa377797f6e11ca52', 'request_id': 'req-ade8d53b-5634-49ed-9a97-94c47e195db7'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.850303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] The token cache is being invalidate because project 093a115dd41549e9b7388d79d9685038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:28.850696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.852112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.854370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 848/1671] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:28 2022] DELETE /identity/v3/projects/093a115dd41549e9b7388d79d9685038 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:28.855476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:28.857731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:28.861449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8035d5a6b58456aa377797f6e11ca52', 'request_id': 'req-ade8d53b-5634-49ed-9a97-94c47e195db7'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.882624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] The token cache is being invalidate because project a8035d5a6b58456aa377797f6e11ca52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:28.883825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.886413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ade8d53b-5634-49ed-9a97-94c47e195db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:28.890856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 824/1672] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:28 2022] DELETE /identity/v3/projects/a8035d5a6b58456aa377797f6e11ca52 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:24:28.892438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ab100-9fad-4f76-9726-7c8a55726141 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:28.894760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ab100-9fad-4f76-9726-7c8a55726141 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:28.895187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ab100-9fad-4f76-9726-7c8a55726141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:28.983602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-095ab100-9fad-4f76-9726-7c8a55726141 None None] MFA Rules not processed for user `8fca30ec1e3e4646991fdbbf9f841495`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:28.984826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-095ab100-9fad-4f76-9726-7c8a55726141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:29.047450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a7ca5-e65e-47d3-be50-a4ae552dce13 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:29.150980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 825/1673] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:28 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:29.151996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b66fe-1547-4394-b063-16f22f9e2b8e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.152290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b66fe-1547-4394-b063-16f22f9e2b8e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.152571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b66fe-1547-4394-b063-16f22f9e2b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.204904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-cd1b66fe-1547-4394-b063-16f22f9e2b8e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:29.208651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cd1b66fe-1547-4394-b063-16f22f9e2b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:29.219879 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc5dc9-435a-4c16-ba1f-c38ef5df0cae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35ae873d42b490cae4dd610f2ac6a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:29.220565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc5dc9-435a-4c16-ba1f-c38ef5df0cae service placement] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.220852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc5dc9-435a-4c16-ba1f-c38ef5df0cae service placement] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.221132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc5dc9-435a-4c16-ba1f-c38ef5df0cae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.230807 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-93fc5dc9-435a-4c16-ba1f-c38ef5df0cae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:29.263156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc5dc9-435a-4c16-ba1f-c38ef5df0cae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:29.266346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc5dc9-435a-4c16-ba1f-c38ef5df0cae service placement] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:29.310036 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 849/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:29.315663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b924c-69ca-4edd-97f6-5745a10bfae9 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.315991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b924c-69ca-4edd-97f6-5745a10bfae9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.316271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b924c-69ca-4edd-97f6-5745a10bfae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.377464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ec2b924c-69ca-4edd-97f6-5745a10bfae9 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:29.378645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ec2b924c-69ca-4edd-97f6-5745a10bfae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:29.412745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 826/1675] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:29.424616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d213a-7848-4a4e-b492-ecf33c11b4a3 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.425001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d213a-7848-4a4e-b492-ecf33c11b4a3 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.425182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d213a-7848-4a4e-b492-ecf33c11b4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.426942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 850/1676] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:29.428408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26f16b-f31f-48d0-9c7c-0ec8047b0c09 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.428699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26f16b-f31f-48d0-9c7c-0ec8047b0c09 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.428974 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26f16b-f31f-48d0-9c7c-0ec8047b0c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.482197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d17d213a-7848-4a4e-b492-ecf33c11b4a3 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:29.483579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d17d213a-7848-4a4e-b492-ecf33c11b4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:29.490672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-cf26f16b-f31f-48d0-9c7c-0ec8047b0c09 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:29.493487 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-cf26f16b-f31f-48d0-9c7c-0ec8047b0c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:29.501568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 827/1677] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:29.507105 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d213a-7848-4a4e-b492-ecf33c11b4a3 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:29.516549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 851/1678] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:29.517728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26f16b-f31f-48d0-9c7c-0ec8047b0c09 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:29.529462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d213a-7848-4a4e-b492-ecf33c11b4a3 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:29.535394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26f16b-f31f-48d0-9c7c-0ec8047b0c09 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:29.541113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce7dd-e9a8-42b4-b56e-899602858e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:29.542039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce7dd-e9a8-42b4-b56e-899602858e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.542575 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce7dd-e9a8-42b4-b56e-899602858e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.543046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce7dd-e9a8-42b4-b56e-899602858e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.543984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ce7dd-e9a8-42b4-b56e-899602858e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:29.544481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ce7dd-e9a8-42b4-b56e-899602858e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:29.546382 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ce7dd-e9a8-42b4-b56e-899602858e34 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:29.551718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3dfe7-e48f-4b5e-bbe8-1ddf69cd6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:29.552619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3dfe7-e48f-4b5e-bbe8-1ddf69cd6da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.553024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3dfe7-e48f-4b5e-bbe8-1ddf69cd6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.553379 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3dfe7-e48f-4b5e-bbe8-1ddf69cd6da8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.555372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3dfe7-e48f-4b5e-bbe8-1ddf69cd6da8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:29.555372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3dfe7-e48f-4b5e-bbe8-1ddf69cd6da8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:29.561876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3dfe7-e48f-4b5e-bbe8-1ddf69cd6da8 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:29.566655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 828/1679] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:29.568296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce7dd-e9a8-42b4-b56e-899602858e34 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:29.581734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce7dd-e9a8-42b4-b56e-899602858e34 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:29.588796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180a4a-2ebe-41a1-971e-a69e71294b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:29.590543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180a4a-2ebe-41a1-971e-a69e71294b10 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.591084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180a4a-2ebe-41a1-971e-a69e71294b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.592916 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180a4a-2ebe-41a1-971e-a69e71294b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.593901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180a4a-2ebe-41a1-971e-a69e71294b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:29.597437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180a4a-2ebe-41a1-971e-a69e71294b10 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:29.609557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 852/1680] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:29.611411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3dfe7-e48f-4b5e-bbe8-1ddf69cd6da8 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:29.639168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3dfe7-e48f-4b5e-bbe8-1ddf69cd6da8 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:29.644281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 829/1681] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:29 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:29.649448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180a4a-2ebe-41a1-971e-a69e71294b10 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:29.660710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483a06b-a429-4796-b25d-2ad4d625d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:29.662253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483a06b-a429-4796-b25d-2ad4d625d78f admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.662253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483a06b-a429-4796-b25d-2ad4d625d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.662253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483a06b-a429-4796-b25d-2ad4d625d78f admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.662932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483a06b-a429-4796-b25d-2ad4d625d78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:29.681890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483a06b-a429-4796-b25d-2ad4d625d78f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:29.753592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 853/1682] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:29 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:24:29.757655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483a06b-a429-4796-b25d-2ad4d625d78f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:29.810613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180a4a-2ebe-41a1-971e-a69e71294b10 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:29.973396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483a06b-a429-4796-b25d-2ad4d625d78f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:29.987171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110f416-9659-486c-89f6-bb3561e78421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:29.987882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f416-9659-486c-89f6-bb3561e78421 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.988170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f416-9659-486c-89f6-bb3561e78421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:29.988449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f416-9659-486c-89f6-bb3561e78421 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:29.989157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110f416-9659-486c-89f6-bb3561e78421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:29.998340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae77b6-4be8-4c5b-a934-7be18a1961b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:29.999461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae77b6-4be8-4c5b-a934-7be18a1961b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:29.999914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae77b6-4be8-4c5b-a934-7be18a1961b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.000434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110f416-9659-486c-89f6-bb3561e78421 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.001776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae77b6-4be8-4c5b-a934-7be18a1961b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.003239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae77b6-4be8-4c5b-a934-7be18a1961b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:30.006604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae77b6-4be8-4c5b-a934-7be18a1961b7 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.049732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 830/1683] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:29 2022] POST /identity/v3/users => generated 293 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:30.053747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae77b6-4be8-4c5b-a934-7be18a1961b7 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.063444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 854/1684] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:29 2022] POST /identity/v3/users => generated 283 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:24:30.067467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110f416-9659-486c-89f6-bb3561e78421 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.074003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae77b6-4be8-4c5b-a934-7be18a1961b7 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:30.087699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110f416-9659-486c-89f6-bb3561e78421 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:30.091330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b17eb6-3af2-4a0a-b893-b2524f1917d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:30.092317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b17eb6-3af2-4a0a-b893-b2524f1917d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.092609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b17eb6-3af2-4a0a-b893-b2524f1917d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.093027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b17eb6-3af2-4a0a-b893-b2524f1917d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.093630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b17eb6-3af2-4a0a-b893-b2524f1917d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:30.096595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b17eb6-3af2-4a0a-b893-b2524f1917d0 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.101527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a416d71-d270-4142-a999-78ba33a74527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:30.102746 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a416d71-d270-4142-a999-78ba33a74527 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.103236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a416d71-d270-4142-a999-78ba33a74527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.103718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a416d71-d270-4142-a999-78ba33a74527 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.104722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a416d71-d270-4142-a999-78ba33a74527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:30.108041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a416d71-d270-4142-a999-78ba33a74527 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.131342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 855/1685] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:24:30.134603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a416d71-d270-4142-a999-78ba33a74527 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.136758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 831/1686] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:24:30.145545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b17eb6-3af2-4a0a-b893-b2524f1917d0 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.164579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b17eb6-3af2-4a0a-b893-b2524f1917d0 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:30.178651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a416d71-d270-4142-a999-78ba33a74527 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:30.179666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b38c68-93bd-422c-a20f-e255bbd747aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:30.180545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b38c68-93bd-422c-a20f-e255bbd747aa admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.180652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b38c68-93bd-422c-a20f-e255bbd747aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.180940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b38c68-93bd-422c-a20f-e255bbd747aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.181683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b38c68-93bd-422c-a20f-e255bbd747aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:30.185741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b38c68-93bd-422c-a20f-e255bbd747aa admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.189380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf3479-0355-4e99-8be3-70f1bd4ba0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:30.190221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf3479-0355-4e99-8be3-70f1bd4ba0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.191919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf3479-0355-4e99-8be3-70f1bd4ba0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.192654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf3479-0355-4e99-8be3-70f1bd4ba0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.193801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf3479-0355-4e99-8be3-70f1bd4ba0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:30.196135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf3479-0355-4e99-8be3-70f1bd4ba0f3 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.214194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 856/1687] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:30.215764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf3479-0355-4e99-8be3-70f1bd4ba0f3 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.233188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 832/1688] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:30.241520 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b38c68-93bd-422c-a20f-e255bbd747aa admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.243266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf3479-0355-4e99-8be3-70f1bd4ba0f3 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:30.256537 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0b7a8-e0e7-4d2e-8993-f1612d1b9910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:30.257976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0b7a8-e0e7-4d2e-8993-f1612d1b9910 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.258821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0b7a8-e0e7-4d2e-8993-f1612d1b9910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.259176 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0b7a8-e0e7-4d2e-8993-f1612d1b9910 admin admin] PATH_INFO: `/v3/projects/1a2ed345da3249098b71b726faba12b1/users/5cb79890be8c46928a4ac4db4c1624ab/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.268609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b38c68-93bd-422c-a20f-e255bbd747aa admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:30.297705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0b7a8-e0e7-4d2e-8993-f1612d1b9910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2ed345da3249098b71b726faba12b1, user_id=5cb79890be8c46928a4ac4db4c1624ab, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:30.308325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0b7a8-e0e7-4d2e-8993-f1612d1b9910 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.316007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f1a5-0125-48f0-b657-52b24689f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:30.318232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f1a5-0125-48f0-b657-52b24689f513 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.318232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f1a5-0125-48f0-b657-52b24689f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.318232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f1a5-0125-48f0-b657-52b24689f513 admin admin] PATH_INFO: `/v3/projects/435d94c90642468fb359593817a53d13/users/07e496534d854eed94684d1bd5123cf3/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.333573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 857/1689] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:30 2022] PUT /identity/v3/projects/1a2ed345da3249098b71b726faba12b1/users/5cb79890be8c46928a4ac4db4c1624ab/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:24:30.347950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534eba5-9547-44d6-b36f-bcba5129cd98 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.352100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534eba5-9547-44d6-b36f-bcba5129cd98 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.352762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534eba5-9547-44d6-b36f-bcba5129cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.358941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f1a5-0125-48f0-b657-52b24689f513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435d94c90642468fb359593817a53d13, user_id=07e496534d854eed94684d1bd5123cf3, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:30.361669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f1a5-0125-48f0-b657-52b24689f513 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.421228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 833/1690] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:30 2022] PUT /identity/v3/projects/435d94c90642468fb359593817a53d13/users/07e496534d854eed94684d1bd5123cf3/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:30.421228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53716a-56e2-46e3-baa2-16415987e257 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.421228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53716a-56e2-46e3-baa2-16415987e257 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.421228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53716a-56e2-46e3-baa2-16415987e257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.452135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-5534eba5-9547-44d6-b36f-bcba5129cd98 None None] MFA Rules not processed for user `5cb79890be8c46928a4ac4db4c1624ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:30.452360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3e53716a-56e2-46e3-baa2-16415987e257 None None] MFA Rules not processed for user `07e496534d854eed94684d1bd5123cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:30.453426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-5534eba5-9547-44d6-b36f-bcba5129cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:30.453858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3e53716a-56e2-46e3-baa2-16415987e257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:30.609279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 834/1691] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:24:30.613506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53716a-56e2-46e3-baa2-16415987e257 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.628991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 858/1692] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:30.633943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534eba5-9547-44d6-b36f-bcba5129cd98 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.769656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53716a-56e2-46e3-baa2-16415987e257 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:30.782014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534eba5-9547-44d6-b36f-bcba5129cd98 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:30.783701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41053-71ce-4fe0-933d-25c1a8626544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:30.784651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41053-71ce-4fe0-933d-25c1a8626544 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.784951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41053-71ce-4fe0-933d-25c1a8626544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.785226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41053-71ce-4fe0-933d-25c1a8626544 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.786068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab41053-71ce-4fe0-933d-25c1a8626544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:30.788164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab41053-71ce-4fe0-933d-25c1a8626544 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.791139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef4cff-919e-4d1e-a784-cfbf813ba421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:30.791982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef4cff-919e-4d1e-a784-cfbf813ba421 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:30.792358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef4cff-919e-4d1e-a784-cfbf813ba421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:30.792749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef4cff-919e-4d1e-a784-cfbf813ba421 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:30.793542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef4cff-919e-4d1e-a784-cfbf813ba421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:30.796230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef4cff-919e-4d1e-a784-cfbf813ba421 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:30.828042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 859/1693] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:30 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:30.831964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef4cff-919e-4d1e-a784-cfbf813ba421 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.846935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 835/1694] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:30 2022] POST /identity/v3/projects => generated 387 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:30.850801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41053-71ce-4fe0-933d-25c1a8626544 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:30.984187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41053-71ce-4fe0-933d-25c1a8626544 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.000220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef4cff-919e-4d1e-a784-cfbf813ba421 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.002272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5c21d-4c0e-446f-aa17-268ac59c6488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.002978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5c21d-4c0e-446f-aa17-268ac59c6488 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.003269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5c21d-4c0e-446f-aa17-268ac59c6488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.003555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5c21d-4c0e-446f-aa17-268ac59c6488 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.004266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5c21d-4c0e-446f-aa17-268ac59c6488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.005758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1a16-e4b6-4665-96e0-d3deccade178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.006345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1a16-e4b6-4665-96e0-d3deccade178 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.006721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1a16-e4b6-4665-96e0-d3deccade178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.007283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1a16-e4b6-4665-96e0-d3deccade178 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.008110 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da1a16-e4b6-4665-96e0-d3deccade178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.009294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5c21d-4c0e-446f-aa17-268ac59c6488 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.010245 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da1a16-e4b6-4665-96e0-d3deccade178 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.042248 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 860/1695] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:30 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:31.043396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1a16-e4b6-4665-96e0-d3deccade178 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.057431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 836/1696] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:30 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:24:31.061440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1a16-e4b6-4665-96e0-d3deccade178 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.062280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5c21d-4c0e-446f-aa17-268ac59c6488 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.067553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc408e77-4add-4861-b0e4-65732670df52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.068445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc408e77-4add-4861-b0e4-65732670df52 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.068762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc408e77-4add-4861-b0e4-65732670df52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.069038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc408e77-4add-4861-b0e4-65732670df52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.069805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc408e77-4add-4861-b0e4-65732670df52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.071517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc408e77-4add-4861-b0e4-65732670df52 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.083934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5c21d-4c0e-446f-aa17-268ac59c6488 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.089718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 861/1697] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:31.095297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc408e77-4add-4861-b0e4-65732670df52 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.095909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5163f-ff6e-4796-9ca2-76910b4d65cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.096607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5163f-ff6e-4796-9ca2-76910b4d65cc admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.096894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5163f-ff6e-4796-9ca2-76910b4d65cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.097226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5163f-ff6e-4796-9ca2-76910b4d65cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.097968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5163f-ff6e-4796-9ca2-76910b4d65cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.099617 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5163f-ff6e-4796-9ca2-76910b4d65cc admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.117435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 837/1698] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:24:31.118862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5163f-ff6e-4796-9ca2-76910b4d65cc admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.128009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc408e77-4add-4861-b0e4-65732670df52 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.130592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5163f-ff6e-4796-9ca2-76910b4d65cc admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.136305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129dd63-b632-47c9-a447-b69792d12601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.137652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129dd63-b632-47c9-a447-b69792d12601 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.137949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129dd63-b632-47c9-a447-b69792d12601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.138262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129dd63-b632-47c9-a447-b69792d12601 admin admin] PATH_INFO: `/v3/projects/be7eec2b70b743739a08451c27eacdcb/users/18cf0d98996c4ca4866c0c186dec8731/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.155009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27bc17-f247-4ff1-9652-5f951e5343f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.155920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27bc17-f247-4ff1-9652-5f951e5343f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.156208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27bc17-f247-4ff1-9652-5f951e5343f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.156486 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27bc17-f247-4ff1-9652-5f951e5343f6 admin admin] PATH_INFO: `/v3/projects/f727a3b361944bd998a7b479d8329f43/users/65067a4f8f1a418d94228f24841f03ca/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.162006 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129dd63-b632-47c9-a447-b69792d12601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7eec2b70b743739a08451c27eacdcb, user_id=18cf0d98996c4ca4866c0c186dec8731, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.165355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129dd63-b632-47c9-a447-b69792d12601 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.175229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27bc17-f247-4ff1-9652-5f951e5343f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f727a3b361944bd998a7b479d8329f43, user_id=65067a4f8f1a418d94228f24841f03ca, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.179028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27bc17-f247-4ff1-9652-5f951e5343f6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.190687 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 838/1699] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:31 2022] PUT /identity/v3/projects/be7eec2b70b743739a08451c27eacdcb/users/18cf0d98996c4ca4866c0c186dec8731/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:31.198747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129dd63-b632-47c9-a447-b69792d12601 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.210122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 862/1700] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:31 2022] PUT /identity/v3/projects/f727a3b361944bd998a7b479d8329f43/users/65067a4f8f1a418d94228f24841f03ca/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:31.217296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27bc17-f247-4ff1-9652-5f951e5343f6 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.393033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129dd63-b632-47c9-a447-b69792d12601 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.407817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31906840-6b24-4eb5-9f47-e82d35de6343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.408728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906840-6b24-4eb5-9f47-e82d35de6343 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.410652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906840-6b24-4eb5-9f47-e82d35de6343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.411101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906840-6b24-4eb5-9f47-e82d35de6343 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.411980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31906840-6b24-4eb5-9f47-e82d35de6343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.413472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27bc17-f247-4ff1-9652-5f951e5343f6 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.416497 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31906840-6b24-4eb5-9f47-e82d35de6343 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.428265 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e9a08-84c1-4f32-b9c2-6054fd3f8608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.428962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e9a08-84c1-4f32-b9c2-6054fd3f8608 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.429920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e9a08-84c1-4f32-b9c2-6054fd3f8608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.430239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e9a08-84c1-4f32-b9c2-6054fd3f8608 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.430976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e9a08-84c1-4f32-b9c2-6054fd3f8608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.432604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e9a08-84c1-4f32-b9c2-6054fd3f8608 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.437551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 839/1701] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:31.442782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31906840-6b24-4eb5-9f47-e82d35de6343 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.458877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31906840-6b24-4eb5-9f47-e82d35de6343 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.459472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 863/1702] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:31.460638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e9a08-84c1-4f32-b9c2-6054fd3f8608 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.472954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9ecc9-2539-4867-8ef9-c7120a534007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.474187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9ecc9-2539-4867-8ef9-c7120a534007 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.474610 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9ecc9-2539-4867-8ef9-c7120a534007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.475025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9ecc9-2539-4867-8ef9-c7120a534007 admin admin] PATH_INFO: `/v3/projects/be7eec2b70b743739a08451c27eacdcb/users/18cf0d98996c4ca4866c0c186dec8731/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.480449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9ecc9-2539-4867-8ef9-c7120a534007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7eec2b70b743739a08451c27eacdcb, user_id=18cf0d98996c4ca4866c0c186dec8731, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.483540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e9a08-84c1-4f32-b9c2-6054fd3f8608 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.486600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9ecc9-2539-4867-8ef9-c7120a534007 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.498015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90143a61-83cd-4359-ac4b-b9cd8fcb6d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.499270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90143a61-83cd-4359-ac4b-b9cd8fcb6d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.499876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90143a61-83cd-4359-ac4b-b9cd8fcb6d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.500376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90143a61-83cd-4359-ac4b-b9cd8fcb6d62 admin admin] PATH_INFO: `/v3/projects/f727a3b361944bd998a7b479d8329f43/users/65067a4f8f1a418d94228f24841f03ca/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.503952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90143a61-83cd-4359-ac4b-b9cd8fcb6d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f727a3b361944bd998a7b479d8329f43, user_id=65067a4f8f1a418d94228f24841f03ca, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.509514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90143a61-83cd-4359-ac4b-b9cd8fcb6d62 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.513562 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 840/1703] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:31 2022] PUT /identity/v3/projects/be7eec2b70b743739a08451c27eacdcb/users/18cf0d98996c4ca4866c0c186dec8731/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:31.524808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb8f5-3c62-409b-a954-6350b5b99d5d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.525354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb8f5-3c62-409b-a954-6350b5b99d5d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.525789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb8f5-3c62-409b-a954-6350b5b99d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.541886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 864/1704] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:31 2022] PUT /identity/v3/projects/f727a3b361944bd998a7b479d8329f43/users/65067a4f8f1a418d94228f24841f03ca/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:31.552318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10df19-3c42-4209-8ef0-76a05fd681fe None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.552818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10df19-3c42-4209-8ef0-76a05fd681fe None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.554759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10df19-3c42-4209-8ef0-76a05fd681fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.585415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-799fb8f5-3c62-409b-a954-6350b5b99d5d None None] MFA Rules not processed for user `18cf0d98996c4ca4866c0c186dec8731`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:31.586999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-799fb8f5-3c62-409b-a954-6350b5b99d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:31.611916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0a10df19-3c42-4209-8ef0-76a05fd681fe None None] MFA Rules not processed for user `65067a4f8f1a418d94228f24841f03ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:31.613920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0a10df19-3c42-4209-8ef0-76a05fd681fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:31.754653 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 865/1705] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:31.774491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 841/1706] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:31.776397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10df19-3c42-4209-8ef0-76a05fd681fe None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.779187 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0a10df19-3c42-4209-8ef0-76a05fd681fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:31.863206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10df19-3c42-4209-8ef0-76a05fd681fe None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.868022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc35232-8bd0-43ba-b5fb-a29b10f12059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.868940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35232-8bd0-43ba-b5fb-a29b10f12059 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.870040 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35232-8bd0-43ba-b5fb-a29b10f12059 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.870488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35232-8bd0-43ba-b5fb-a29b10f12059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.883885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc35232-8bd0-43ba-b5fb-a29b10f12059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.886154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc35232-8bd0-43ba-b5fb-a29b10f12059 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:31.902611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 866/1707] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:31.931941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb8f5-3c62-409b-a954-6350b5b99d5d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.934504 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-799fb8f5-3c62-409b-a954-6350b5b99d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:31.948519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb8f5-3c62-409b-a954-6350b5b99d5d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:31.953593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf80308-0d86-485b-a5c9-95927b1a65aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:31.954333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf80308-0d86-485b-a5c9-95927b1a65aa service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:31.957237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc35232-8bd0-43ba-b5fb-a29b10f12059 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:31.960019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf80308-0d86-485b-a5c9-95927b1a65aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:31.964279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf80308-0d86-485b-a5c9-95927b1a65aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:31.991557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf80308-0d86-485b-a5c9-95927b1a65aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:31.993933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf80308-0d86-485b-a5c9-95927b1a65aa service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:32.033553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 842/1708] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:32.126165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc35232-8bd0-43ba-b5fb-a29b10f12059 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:32.136575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:32.146149 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:32.146149 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:32.147161 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] PATH_INFO: `/v3/users/07e496534d854eed94684d1bd5123cf3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:32.151087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e496534d854eed94684d1bd5123cf3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:32.157524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:32.169870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf80308-0d86-485b-a5c9-95927b1a65aa service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:32.183723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf80308-0d86-485b-a5c9-95927b1a65aa service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:32.190869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d87983-a2dd-4687-93fb-23645e15b06b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:32.197058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87983-a2dd-4687-93fb-23645e15b06b service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:32.197948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87983-a2dd-4687-93fb-23645e15b06b service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:32.198354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87983-a2dd-4687-93fb-23645e15b06b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:32.265296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e496534d854eed94684d1bd5123cf3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:32.280938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e496534d854eed94684d1bd5123cf3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:32.293001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d87983-a2dd-4687-93fb-23645e15b06b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:32.294964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d87983-a2dd-4687-93fb-23645e15b06b service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:32.301570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e496534d854eed94684d1bd5123cf3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:32.302100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e496534d854eed94684d1bd5123cf3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:32.304638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e496534d854eed94684d1bd5123cf3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:32.333969 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 843/1709] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:24:32.338626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 867/1710] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:31 2022] DELETE /identity/v3/users/07e496534d854eed94684d1bd5123cf3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:24:32.343119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40745-d96d-4b9b-a2cd-675c6e6bd25c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:32.343416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40745-d96d-4b9b-a2cd-675c6e6bd25c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:32.343796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40745-d96d-4b9b-a2cd-675c6e6bd25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:32.367439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2cc40745-d96d-4b9b-a2cd-675c6e6bd25c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:32.369095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2cc40745-d96d-4b9b-a2cd-675c6e6bd25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:32.490030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 844/1711] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:32.540159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:32.542423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:32.548475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0d596-de9c-4eeb-8f6b-e0c35d04d0b4 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:32.548765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0d596-de9c-4eeb-8f6b-e0c35d04d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:32.549156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0d596-de9c-4eeb-8f6b-e0c35d04d0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:32.602958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-98e0d596-de9c-4eeb-8f6b-e0c35d04d0b4 None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:32.604373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-98e0d596-de9c-4eeb-8f6b-e0c35d04d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:32.730041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 845/1712] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:24:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:24:32.754233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97904e-fe7a-4726-b44e-da1c891d59da admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:32.758437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62991e2e-f06a-4107-abc1-792e81fb72a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:32.759290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62991e2e-f06a-4107-abc1-792e81fb72a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:32.759587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62991e2e-f06a-4107-abc1-792e81fb72a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:32.759914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62991e2e-f06a-4107-abc1-792e81fb72a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:32.771836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62991e2e-f06a-4107-abc1-792e81fb72a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:32.774862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62991e2e-f06a-4107-abc1-792e81fb72a4 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:32.797863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 868/1713] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:33.054201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0d596-de9c-4eeb-8f6b-e0c35d04d0b4 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:33.055729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-98e0d596-de9c-4eeb-8f6b-e0c35d04d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:33.232075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0d596-de9c-4eeb-8f6b-e0c35d04d0b4 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:33.243720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584791d2-b99f-43a1-a17f-9e821b67f886 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:33.244556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584791d2-b99f-43a1-a17f-9e821b67f886 service swift] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:33.245002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584791d2-b99f-43a1-a17f-9e821b67f886 service swift] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:33.246233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584791d2-b99f-43a1-a17f-9e821b67f886 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:33.256459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584791d2-b99f-43a1-a17f-9e821b67f886 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:33.258875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584791d2-b99f-43a1-a17f-9e821b67f886 service swift] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:33.271537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 846/1714] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:24:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:24:33.468092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62991e2e-f06a-4107-abc1-792e81fb72a4 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:33.469902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-62991e2e-f06a-4107-abc1-792e81fb72a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:33.490473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62991e2e-f06a-4107-abc1-792e81fb72a4 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:33.509589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:33.510836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:33.512082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:33.512502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] PATH_INFO: `/v3/users/f6f5ba2f42bc43858620bba1e6d72a30` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:33.519204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f5ba2f42bc43858620bba1e6d72a30)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:33.522355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:33.692451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f5ba2f42bc43858620bba1e6d72a30'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:33.716732 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f5ba2f42bc43858620bba1e6d72a30'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:33.744462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f5ba2f42bc43858620bba1e6d72a30'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:33.745081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f5ba2f42bc43858620bba1e6d72a30'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:33.745800 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f5ba2f42bc43858620bba1e6d72a30'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:33.826046 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 869/1715] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:33 2022] DELETE /identity/v3/users/f6f5ba2f42bc43858620bba1e6d72a30 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:35.108642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584791d2-b99f-43a1-a17f-9e821b67f886 service swift] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:35.153955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584791d2-b99f-43a1-a17f-9e821b67f886 service swift] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:35.399622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:35.400600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:35.400887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:35.401166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] PATH_INFO: `/v3/projects/4e6c460df5f9481d9ee6963b5bb88307` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:35.407796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6c460df5f9481d9ee6963b5bb88307)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:35.412437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:35.601480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6c460df5f9481d9ee6963b5bb88307', 'request_id': 'req-f8f6eb93-5096-4476-b841-a73ae3d45956'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:35.616300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6c460df5f9481d9ee6963b5bb88307', 'request_id': 'req-f8f6eb93-5096-4476-b841-a73ae3d45956'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:35.633422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6c460df5f9481d9ee6963b5bb88307', 'request_id': 'req-f8f6eb93-5096-4476-b841-a73ae3d45956'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:35.672230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] The token cache is being invalidate because project 4e6c460df5f9481d9ee6963b5bb88307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:35.672549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:35.674535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:35.686543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 847/1716] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:35 2022] DELETE /identity/v3/projects/4e6c460df5f9481d9ee6963b5bb88307 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:35.688225 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:35.690704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:35.750058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a8238-5b06-4cd1-83cf-60295daf18e8 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:36.015418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:36.020362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:36.023730 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:36.025707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] PATH_INFO: `/v3/users/8fca30ec1e3e4646991fdbbf9f841495` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:36.033787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fca30ec1e3e4646991fdbbf9f841495)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:36.043770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:36.118298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:36.121709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:36.138568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6eb93-5096-4476-b841-a73ae3d45956 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:36.145757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:36.147544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:36.148378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:36.148827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] PATH_INFO: `/v3/users/5cb79890be8c46928a4ac4db4c1624ab` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:36.150761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb79890be8c46928a4ac4db4c1624ab)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:36.154660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:36.225360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb79890be8c46928a4ac4db4c1624ab'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.235018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fca30ec1e3e4646991fdbbf9f841495'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.248027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb79890be8c46928a4ac4db4c1624ab'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.250594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb79890be8c46928a4ac4db4c1624ab'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.266865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fca30ec1e3e4646991fdbbf9f841495'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.283538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb79890be8c46928a4ac4db4c1624ab'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.292326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fca30ec1e3e4646991fdbbf9f841495'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.293228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fca30ec1e3e4646991fdbbf9f841495'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.294467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-358d778b-76ae-4097-aa9d-642c49c26140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fca30ec1e3e4646991fdbbf9f841495'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.340078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb79890be8c46928a4ac4db4c1624ab'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:36.350404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 870/1718] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:35 2022] DELETE /identity/v3/users/8fca30ec1e3e4646991fdbbf9f841495 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:36.350683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 848/1718] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:36 2022] DELETE /identity/v3/users/5cb79890be8c46928a4ac4db4c1624ab => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:36.359726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7701d-3ff1-4471-9cf1-1bec254161ea None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:36.360023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7701d-3ff1-4471-9cf1-1bec254161ea None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:36.360305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7701d-3ff1-4471-9cf1-1bec254161ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:36.395456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c8b7701d-3ff1-4471-9cf1-1bec254161ea None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:36.397394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c8b7701d-3ff1-4471-9cf1-1bec254161ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:36.488029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 871/1719] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:36.855646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:36.857173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:37.062845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7701d-3ff1-4471-9cf1-1bec254161ea None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:37.064540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c8b7701d-3ff1-4471-9cf1-1bec254161ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:37.087663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb87d2c-aabe-48cb-8aa9-d9192334f693 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:37.113875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7701d-3ff1-4471-9cf1-1bec254161ea None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:37.155919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:37.156822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:37.157107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:37.157385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] PATH_INFO: `/v3/projects/435d94c90642468fb359593817a53d13` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:37.171154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435d94c90642468fb359593817a53d13)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:37.173328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:37.412624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdcfdc-8bcd-41df-8647-5df09d4cbc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:37.413330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcfdc-8bcd-41df-8647-5df09d4cbc67 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:37.413616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcfdc-8bcd-41df-8647-5df09d4cbc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:37.413949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcfdc-8bcd-41df-8647-5df09d4cbc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:37.456131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdcfdc-8bcd-41df-8647-5df09d4cbc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:37.464541 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdcfdc-8bcd-41df-8647-5df09d4cbc67 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:37.466458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435d94c90642468fb359593817a53d13', 'request_id': 'req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:37.487384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435d94c90642468fb359593817a53d13', 'request_id': 'req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:37.510697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 849/1720] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:37.512473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435d94c90642468fb359593817a53d13', 'request_id': 'req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:37.536431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] The token cache is being invalidate because project 435d94c90642468fb359593817a53d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:37.536737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:37.537455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:37.542144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 872/1721] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:37 2022] DELETE /identity/v3/projects/435d94c90642468fb359593817a53d13 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:37.545894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdcfdc-8bcd-41df-8647-5df09d4cbc67 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:37.564769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdcfdc-8bcd-41df-8647-5df09d4cbc67 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:37.843810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:37.845205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:37.845544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:37.850296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] PATH_INFO: `/v3/users/18cf0d98996c4ca4866c0c186dec8731` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:37.853654 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=18cf0d98996c4ca4866c0c186dec8731)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:37.858319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:38.068111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18cf0d98996c4ca4866c0c186dec8731'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:38.083234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18cf0d98996c4ca4866c0c186dec8731'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:38.084258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18cf0d98996c4ca4866c0c186dec8731'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:38.114524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18cf0d98996c4ca4866c0c186dec8731'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:38.220714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-455711f6-f9c7-4d71-96ab-ec4dc22303fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18cf0d98996c4ca4866c0c186dec8731'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:38.245017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 850/1722] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:37 2022] DELETE /identity/v3/users/18cf0d98996c4ca4866c0c186dec8731 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:39.065915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:39.069339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:39.127988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30aaa4-8ede-4d4e-8d5f-918d9027a829 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:39.277137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:39.278217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:39.278604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:39.279127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] PATH_INFO: `/v3/projects/4931f4b0e7124118b8b187251f64db06` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:39.280606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4931f4b0e7124118b8b187251f64db06)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:39.283786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:39.368963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4931f4b0e7124118b8b187251f64db06', 'request_id': 'req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:39.384804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4931f4b0e7124118b8b187251f64db06', 'request_id': 'req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:39.403174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4931f4b0e7124118b8b187251f64db06', 'request_id': 'req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:39.485801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] The token cache is being invalidate because project 4931f4b0e7124118b8b187251f64db06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:39.486126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:39.486848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8a5c0a4-51d1-46bb-ae97-21b45cd82049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:39.489932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 873/1723] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:39 2022] DELETE /identity/v3/projects/4931f4b0e7124118b8b187251f64db06 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:39.496838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff48965-9300-47d7-9652-6ad8b0c4f305 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:39.497327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff48965-9300-47d7-9652-6ad8b0c4f305 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:39.497428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff48965-9300-47d7-9652-6ad8b0c4f305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:39.576637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1ff48965-9300-47d7-9652-6ad8b0c4f305 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:39.582604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1ff48965-9300-47d7-9652-6ad8b0c4f305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:39.770663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44ccb-c3f4-43d6-94d0-9f3dec55d28c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:39.771029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44ccb-c3f4-43d6-94d0-9f3dec55d28c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:39.771383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44ccb-c3f4-43d6-94d0-9f3dec55d28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:39.799829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 851/1724] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:39.809566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a8e9a-f6fb-4358-8f23-32e32920ecfa None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:39.810243 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a8e9a-f6fb-4358-8f23-32e32920ecfa None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:39.810762 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a8e9a-f6fb-4358-8f23-32e32920ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:39.819302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9da44ccb-c3f4-43d6-94d0-9f3dec55d28c None None] MFA Rules not processed for user `701c0e43cc30442582456f4f7153333a`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:39.821106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9da44ccb-c3f4-43d6-94d0-9f3dec55d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:39.836062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ac7a8e9a-f6fb-4358-8f23-32e32920ecfa None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:39.836942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ac7a8e9a-f6fb-4358-8f23-32e32920ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:39.861575 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 852/1725] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:39.868484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a8e9a-f6fb-4358-8f23-32e32920ecfa None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:39.903593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a8e9a-f6fb-4358-8f23-32e32920ecfa None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:39.914710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ef77a-be8e-4ca2-83d8-62cae0077472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:39.916019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ef77a-be8e-4ca2-83d8-62cae0077472 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:39.916472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ef77a-be8e-4ca2-83d8-62cae0077472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:39.916898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ef77a-be8e-4ca2-83d8-62cae0077472 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:39.917800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ef77a-be8e-4ca2-83d8-62cae0077472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:39.918297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ef77a-be8e-4ca2-83d8-62cae0077472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:39.920186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ef77a-be8e-4ca2-83d8-62cae0077472 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:39.937882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 853/1726] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:24:39.941919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ef77a-be8e-4ca2-83d8-62cae0077472 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:39.957134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ef77a-be8e-4ca2-83d8-62cae0077472 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:39.966812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ab0c8-bb16-4266-a0dc-a469a40cabac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:39.971496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ab0c8-bb16-4266-a0dc-a469a40cabac admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:39.971734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ab0c8-bb16-4266-a0dc-a469a40cabac admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:39.973636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ab0c8-bb16-4266-a0dc-a469a40cabac admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:39.974396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ab0c8-bb16-4266-a0dc-a469a40cabac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:39.995480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ab0c8-bb16-4266-a0dc-a469a40cabac admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:40.049328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 854/1727] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:39 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:40.051545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 874/1728] 10.222.0.37 () {58 vars in 1015 bytes} [Thu Mar 10 17:24:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:40.052121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ab0c8-bb16-4266-a0dc-a469a40cabac admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:40.211327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ab0c8-bb16-4266-a0dc-a469a40cabac admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:40.225369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd1e05-10c9-449b-9728-2c4326f006af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:40.226620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd1e05-10c9-449b-9728-2c4326f006af admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:40.226982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd1e05-10c9-449b-9728-2c4326f006af admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:40.227175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd1e05-10c9-449b-9728-2c4326f006af admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:40.227882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd1e05-10c9-449b-9728-2c4326f006af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:40.239912 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd1e05-10c9-449b-9728-2c4326f006af admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:40.348668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 855/1729] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:40 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:40.353213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44ccb-c3f4-43d6-94d0-9f3dec55d28c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:40.372135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44ccb-c3f4-43d6-94d0-9f3dec55d28c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:40.378734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa3ed5-3925-46f2-b024-8e0c62a03a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:40.379694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3ed5-3925-46f2-b024-8e0c62a03a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:40.380234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3ed5-3925-46f2-b024-8e0c62a03a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:40.380797 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3ed5-3925-46f2-b024-8e0c62a03a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:40.382416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa3ed5-3925-46f2-b024-8e0c62a03a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:40.385078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa3ed5-3925-46f2-b024-8e0c62a03a61 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:40.413849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 875/1730] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:24:40.417657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd1e05-10c9-449b-9728-2c4326f006af admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:40.439288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd1e05-10c9-449b-9728-2c4326f006af admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:40.450590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc703d3-dc02-4472-a850-3709286086b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:40.452580 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc703d3-dc02-4472-a850-3709286086b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:40.454351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc703d3-dc02-4472-a850-3709286086b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:40.454351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc703d3-dc02-4472-a850-3709286086b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:40.456676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa3ed5-3925-46f2-b024-8e0c62a03a61 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:40.458742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4bfa3ed5-3925-46f2-b024-8e0c62a03a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:40.463583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc703d3-dc02-4472-a850-3709286086b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:40.473266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc703d3-dc02-4472-a850-3709286086b2 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:40.504967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 856/1731] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:24:40.510370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc703d3-dc02-4472-a850-3709286086b2 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:40.551653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc703d3-dc02-4472-a850-3709286086b2 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:40.570756 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694c6f7-b41c-452d-acd7-7e89f84198fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:40.572008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c6f7-b41c-452d-acd7-7e89f84198fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:40.572476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c6f7-b41c-452d-acd7-7e89f84198fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:40.572935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c6f7-b41c-452d-acd7-7e89f84198fa admin admin] PATH_INFO: `/v3/projects/70d9e99c491a430eb9c73576877d896e/users/12771bb265f744a4bfd13ac8a819670a/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:40.604314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694c6f7-b41c-452d-acd7-7e89f84198fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d9e99c491a430eb9c73576877d896e, user_id=12771bb265f744a4bfd13ac8a819670a, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:40.608797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694c6f7-b41c-452d-acd7-7e89f84198fa admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:40.628562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa3ed5-3925-46f2-b024-8e0c62a03a61 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:40.637157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 857/1732] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:40 2022] PUT /identity/v3/projects/70d9e99c491a430eb9c73576877d896e/users/12771bb265f744a4bfd13ac8a819670a/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:40.649926 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcd48c-aa0a-4869-a2e2-18b089ab9570 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:40.650564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcd48c-aa0a-4869-a2e2-18b089ab9570 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:40.651053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcd48c-aa0a-4869-a2e2-18b089ab9570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:40.744545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-28bcd48c-aa0a-4869-a2e2-18b089ab9570 None None] MFA Rules not processed for user `12771bb265f744a4bfd13ac8a819670a`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:40.746711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-28bcd48c-aa0a-4869-a2e2-18b089ab9570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:40.764559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33a752-ee7f-4583-9516-9d65b145ce6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:40.765461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33a752-ee7f-4583-9516-9d65b145ce6f service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:40.765748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33a752-ee7f-4583-9516-9d65b145ce6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:40.766423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33a752-ee7f-4583-9516-9d65b145ce6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:40.791164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33a752-ee7f-4583-9516-9d65b145ce6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:40.793011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33a752-ee7f-4583-9516-9d65b145ce6f service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:40.813356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 876/1733] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:24:40.958641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33a752-ee7f-4583-9516-9d65b145ce6f service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:40.961020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ad33a752-ee7f-4583-9516-9d65b145ce6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:40.972237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 858/1734] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:40.987476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcd48c-aa0a-4869-a2e2-18b089ab9570 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:40.991756 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-28bcd48c-aa0a-4869-a2e2-18b089ab9570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:41.245289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcd48c-aa0a-4869-a2e2-18b089ab9570 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:41.258522 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866beb-24bd-4fdb-83fc-d927c97a7364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:41.262871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866beb-24bd-4fdb-83fc-d927c97a7364 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:41.263178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866beb-24bd-4fdb-83fc-d927c97a7364 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:41.263469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866beb-24bd-4fdb-83fc-d927c97a7364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:41.265600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33a752-ee7f-4583-9516-9d65b145ce6f service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:41.287130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:41.287900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07866beb-24bd-4fdb-83fc-d927c97a7364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:41.289671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07866beb-24bd-4fdb-83fc-d927c97a7364 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:41.295020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:41.295308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:41.295717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] PATH_INFO: `/v3/projects/1a2ed345da3249098b71b726faba12b1` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:41.297076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2ed345da3249098b71b726faba12b1)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:41.299025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:41.300299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 859/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:41.302327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83196ec5-5bee-498f-8f19-80ba7f096123 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:41.302626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83196ec5-5bee-498f-8f19-80ba7f096123 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:41.303048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83196ec5-5bee-498f-8f19-80ba7f096123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:41.390431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-83196ec5-5bee-498f-8f19-80ba7f096123 None None] MFA Rules not processed for user `9dbdadbe21e542dcb1c3dad9d67e8a92`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:41.395431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-83196ec5-5bee-498f-8f19-80ba7f096123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:41.419111 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2ed345da3249098b71b726faba12b1', 'request_id': 'req-c1d57eac-c130-48de-94b1-719e9030391a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:41.434624 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2ed345da3249098b71b726faba12b1', 'request_id': 'req-c1d57eac-c130-48de-94b1-719e9030391a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:41.463356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2ed345da3249098b71b726faba12b1', 'request_id': 'req-c1d57eac-c130-48de-94b1-719e9030391a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:41.519305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] The token cache is being invalidate because project 1a2ed345da3249098b71b726faba12b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:41.520901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:41.522897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:41.526903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 877/1736] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:40 2022] DELETE /identity/v3/projects/1a2ed345da3249098b71b726faba12b1 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:41.531054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:41.533502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:41.545727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 860/1737] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:41.558367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83196ec5-5bee-498f-8f19-80ba7f096123 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:41.559785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-83196ec5-5bee-498f-8f19-80ba7f096123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:41.655767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83196ec5-5bee-498f-8f19-80ba7f096123 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:41.727188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:41.728018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:41.728430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:41.728812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:41.731272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:41.807774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d57eac-c130-48de-94b1-719e9030391a admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:41.844362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:41.847460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:41.856485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:41.857227 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:41.857555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:41.857800 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] PATH_INFO: `/v3/users/65067a4f8f1a418d94228f24841f03ca` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:41.872119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65067a4f8f1a418d94228f24841f03ca)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:41.874904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 861/1738] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:24:41.876909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:41.881883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:41.882891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:41.925719 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d9586-85e7-4005-bbd6-0be61dffbf43 service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:41.942946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:41.946252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:41.947687 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:41.949808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] PATH_INFO: `/v3/projects/be7eec2b70b743739a08451c27eacdcb` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:41.954391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7eec2b70b743739a08451c27eacdcb)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:41.973231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:42.107466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65067a4f8f1a418d94228f24841f03ca'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.138055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65067a4f8f1a418d94228f24841f03ca'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.162478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65067a4f8f1a418d94228f24841f03ca'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.163947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65067a4f8f1a418d94228f24841f03ca'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.165273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-89285990-5794-4f38-a1be-1e32c1e66b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65067a4f8f1a418d94228f24841f03ca'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.215063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7eec2b70b743739a08451c27eacdcb', 'request_id': 'req-8149d810-6162-47e0-af34-1ea5dfae3605'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.238691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7eec2b70b743739a08451c27eacdcb', 'request_id': 'req-8149d810-6162-47e0-af34-1ea5dfae3605'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.262721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7eec2b70b743739a08451c27eacdcb', 'request_id': 'req-8149d810-6162-47e0-af34-1ea5dfae3605'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.264209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 878/1739] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:41 2022] DELETE /identity/v3/users/65067a4f8f1a418d94228f24841f03ca => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:24:42.326578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] The token cache is being invalidate because project be7eec2b70b743739a08451c27eacdcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:42.334599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.339814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8149d810-6162-47e0-af34-1ea5dfae3605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:42.345523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 862/1740] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:41 2022] DELETE /identity/v3/projects/be7eec2b70b743739a08451c27eacdcb => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:42.347208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ce146-8c89-4322-b73b-fda5302f8ea5 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:42.347462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ce146-8c89-4322-b73b-fda5302f8ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:42.347705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ce146-8c89-4322-b73b-fda5302f8ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:42.377188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-839ce146-8c89-4322-b73b-fda5302f8ea5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:42.379341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-839ce146-8c89-4322-b73b-fda5302f8ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:42.509975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 879/1741] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:42.520754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0aff4-a0f4-4343-a66e-515869a9e0bd None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:42.521294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0aff4-a0f4-4343-a66e-515869a9e0bd None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:42.521773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0aff4-a0f4-4343-a66e-515869a9e0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:42.565442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-97c0aff4-a0f4-4343-a66e-515869a9e0bd None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:42.567212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-97c0aff4-a0f4-4343-a66e-515869a9e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:42.593492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 863/1742] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:42.596881 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ce146-8c89-4322-b73b-fda5302f8ea5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:42.608172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ce146-8c89-4322-b73b-fda5302f8ea5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:42.637325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a63b35-967f-421e-9804-8e4e6356dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:42.639712 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a63b35-967f-421e-9804-8e4e6356dbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:42.640874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a63b35-967f-421e-9804-8e4e6356dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:42.642122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a63b35-967f-421e-9804-8e4e6356dbb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:42.645944 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a63b35-967f-421e-9804-8e4e6356dbb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:42.647194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a63b35-967f-421e-9804-8e4e6356dbb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:42.650142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a63b35-967f-421e-9804-8e4e6356dbb7 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:42.711104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 880/1743] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:42.712527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0aff4-a0f4-4343-a66e-515869a9e0bd None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:42.731452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0aff4-a0f4-4343-a66e-515869a9e0bd None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:42.769375 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924fbf1-50cf-4d41-ac77-b10a0107a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:42.771531 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924fbf1-50cf-4d41-ac77-b10a0107a152 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:42.771903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924fbf1-50cf-4d41-ac77-b10a0107a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:42.773739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924fbf1-50cf-4d41-ac77-b10a0107a152 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:42.777981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924fbf1-50cf-4d41-ac77-b10a0107a152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:42.782615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924fbf1-50cf-4d41-ac77-b10a0107a152 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:42.892263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 864/1744] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:42 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:42.896054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a63b35-967f-421e-9804-8e4e6356dbb7 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:42.909731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a63b35-967f-421e-9804-8e4e6356dbb7 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:43.055751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924fbf1-50cf-4d41-ac77-b10a0107a152 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:43.058630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7924fbf1-50cf-4d41-ac77-b10a0107a152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:43.094997 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e8058-a8d6-4b97-a853-2f022b968a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:43.098849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e8058-a8d6-4b97-a853-2f022b968a04 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:43.103436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e8058-a8d6-4b97-a853-2f022b968a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:43.104244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e8058-a8d6-4b97-a853-2f022b968a04 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:43.106029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e8058-a8d6-4b97-a853-2f022b968a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:43.112691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e8058-a8d6-4b97-a853-2f022b968a04 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:43.165116 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 881/1745] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:42 2022] POST /identity/v3/users => generated 291 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:43.167165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e8058-a8d6-4b97-a853-2f022b968a04 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:43.191457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e8058-a8d6-4b97-a853-2f022b968a04 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:43.196676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff446-e190-4d86-bed6-499d063bbed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:43.198075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff446-e190-4d86-bed6-499d063bbed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:43.198485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff446-e190-4d86-bed6-499d063bbed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:43.198743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff446-e190-4d86-bed6-499d063bbed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:43.200465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ff446-e190-4d86-bed6-499d063bbed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:43.203529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ff446-e190-4d86-bed6-499d063bbed0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:43.268835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924fbf1-50cf-4d41-ac77-b10a0107a152 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:43.274043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 882/1746] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:43.274043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff446-e190-4d86-bed6-499d063bbed0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:43.288682 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:43.289794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:43.290742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:43.290742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] PATH_INFO: `/v3/projects/f727a3b361944bd998a7b479d8329f43` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:43.295234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f727a3b361944bd998a7b479d8329f43)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:43.300713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff446-e190-4d86-bed6-499d063bbed0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:43.301378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:43.315667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e60bc8-3cdc-4c65-96d0-1529232ee7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:43.316426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60bc8-3cdc-4c65-96d0-1529232ee7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:43.317332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60bc8-3cdc-4c65-96d0-1529232ee7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:43.317696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60bc8-3cdc-4c65-96d0-1529232ee7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:43.322282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e60bc8-3cdc-4c65-96d0-1529232ee7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:43.322282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e60bc8-3cdc-4c65-96d0-1529232ee7c9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:43.343309 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 883/1747] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:43.345492 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e60bc8-3cdc-4c65-96d0-1529232ee7c9 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:43.366782 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e60bc8-3cdc-4c65-96d0-1529232ee7c9 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:43.385734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652a3be-15bf-4f49-858d-68d36aa259a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:43.387408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a3be-15bf-4f49-858d-68d36aa259a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:43.387940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a3be-15bf-4f49-858d-68d36aa259a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:43.388489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a3be-15bf-4f49-858d-68d36aa259a3 admin admin] PATH_INFO: `/v3/projects/1e29f6dc4c1247e4821ccf0bc3e3a01e/users/29d5ade0b0204ccda4b6fbbdb9356c48/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:43.406887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652a3be-15bf-4f49-858d-68d36aa259a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e29f6dc4c1247e4821ccf0bc3e3a01e, user_id=29d5ade0b0204ccda4b6fbbdb9356c48, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:43.410382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652a3be-15bf-4f49-858d-68d36aa259a3 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:43.428022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f727a3b361944bd998a7b479d8329f43', 'request_id': 'req-b6c5f768-3c74-4774-922d-93121a1db0dd'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:43.431343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 884/1748] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:43 2022] PUT /identity/v3/projects/1e29f6dc4c1247e4821ccf0bc3e3a01e/users/29d5ade0b0204ccda4b6fbbdb9356c48/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:43.442671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf433-095f-4fc1-a973-ce2e51e9da36 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:43.443549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf433-095f-4fc1-a973-ce2e51e9da36 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:43.445801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf433-095f-4fc1-a973-ce2e51e9da36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:43.446366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f727a3b361944bd998a7b479d8329f43', 'request_id': 'req-b6c5f768-3c74-4774-922d-93121a1db0dd'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:43.462393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f727a3b361944bd998a7b479d8329f43', 'request_id': 'req-b6c5f768-3c74-4774-922d-93121a1db0dd'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:43.486086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] The token cache is being invalidate because project f727a3b361944bd998a7b479d8329f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:43.486445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:43.489970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6c5f768-3c74-4774-922d-93121a1db0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:43.493429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 865/1749] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:43 2022] DELETE /identity/v3/projects/f727a3b361944bd998a7b479d8329f43 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:24:43.503677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbe2f6-b94f-4045-aa11-298a7f17a07a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:43.503977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbe2f6-b94f-4045-aa11-298a7f17a07a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:43.504261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbe2f6-b94f-4045-aa11-298a7f17a07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:43.516279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-1e6bf433-095f-4fc1-a973-ce2e51e9da36 None None] MFA Rules not processed for user `29d5ade0b0204ccda4b6fbbdb9356c48`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:43.530840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1e6bf433-095f-4fc1-a973-ce2e51e9da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:43.559551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-becbe2f6-b94f-4045-aa11-298a7f17a07a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:43.560805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-becbe2f6-b94f-4045-aa11-298a7f17a07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:43.724526 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 885/1750] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:43.730588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bf433-095f-4fc1-a973-ce2e51e9da36 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:43.732444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1e6bf433-095f-4fc1-a973-ce2e51e9da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:43.740995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 866/1751] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:43.742716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e29ea-fc5b-4c8a-b894-2d46919c16e4 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:43.743015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e29ea-fc5b-4c8a-b894-2d46919c16e4 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:43.743305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e29ea-fc5b-4c8a-b894-2d46919c16e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:43.764578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bf433-095f-4fc1-a973-ce2e51e9da36 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:43.771793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303d59d-6d5b-42af-acfb-65d69cd47aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:43.773329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d59d-6d5b-42af-acfb-65d69cd47aef admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:43.773988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d59d-6d5b-42af-acfb-65d69cd47aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:43.774532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d59d-6d5b-42af-acfb-65d69cd47aef admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:43.775777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303d59d-6d5b-42af-acfb-65d69cd47aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:43.779136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303d59d-6d5b-42af-acfb-65d69cd47aef admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:43.817788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-597e29ea-fc5b-4c8a-b894-2d46919c16e4 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:43.819034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-597e29ea-fc5b-4c8a-b894-2d46919c16e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:43.821390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 886/1752] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:43 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:43.828557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303d59d-6d5b-42af-acfb-65d69cd47aef admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:44.056196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303d59d-6d5b-42af-acfb-65d69cd47aef admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:44.075809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2048a0-8943-4d67-b57e-645ae98f06f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:44.076763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2048a0-8943-4d67-b57e-645ae98f06f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:44.078708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 867/1753] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:44.079228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2048a0-8943-4d67-b57e-645ae98f06f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:44.079691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2048a0-8943-4d67-b57e-645ae98f06f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:44.082434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2048a0-8943-4d67-b57e-645ae98f06f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:44.083364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e29ea-fc5b-4c8a-b894-2d46919c16e4 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:44.088843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2048a0-8943-4d67-b57e-645ae98f06f5 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:44.121796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e29ea-fc5b-4c8a-b894-2d46919c16e4 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:44.140089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8b51c-146a-4f9b-a8a1-e4888af1a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:44.142290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 887/1754] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:43 2022] POST /identity/v3/users => generated 296 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:24:44.143119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8b51c-146a-4f9b-a8a1-e4888af1a4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:44.143418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8b51c-146a-4f9b-a8a1-e4888af1a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:44.144001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8b51c-146a-4f9b-a8a1-e4888af1a4f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:44.144510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8b51c-146a-4f9b-a8a1-e4888af1a4f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:44.146251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2048a0-8943-4d67-b57e-645ae98f06f5 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:44.151190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8b51c-146a-4f9b-a8a1-e4888af1a4f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:44.157203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8b51c-146a-4f9b-a8a1-e4888af1a4f2 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:44.195299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2048a0-8943-4d67-b57e-645ae98f06f5 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:44.205680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 868/1755] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:44.210296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8b51c-146a-4f9b-a8a1-e4888af1a4f2 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:44.230752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba816c-0093-4994-a521-c0d77d0782b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:44.233302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba816c-0093-4994-a521-c0d77d0782b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:44.233901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba816c-0093-4994-a521-c0d77d0782b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:44.234636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba816c-0093-4994-a521-c0d77d0782b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:44.235880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba816c-0093-4994-a521-c0d77d0782b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:44.238186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba816c-0093-4994-a521-c0d77d0782b0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:44.239063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8b51c-146a-4f9b-a8a1-e4888af1a4f2 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:44.264131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29e92-820a-4d5b-9fa8-233f70693a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:44.265495 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29e92-820a-4d5b-9fa8-233f70693a77 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:44.265790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29e92-820a-4d5b-9fa8-233f70693a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:44.266077 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29e92-820a-4d5b-9fa8-233f70693a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:44.267415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e29e92-820a-4d5b-9fa8-233f70693a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:44.271640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e29e92-820a-4d5b-9fa8-233f70693a77 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:44.293469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 888/1756] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:24:44.295731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba816c-0093-4994-a521-c0d77d0782b0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:44.342629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba816c-0093-4994-a521-c0d77d0782b0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:44.348913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc800d-abfa-4c95-bd71-e55db1b02ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:44.349867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc800d-abfa-4c95-bd71-e55db1b02ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:44.355333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc800d-abfa-4c95-bd71-e55db1b02ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:44.355647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc800d-abfa-4c95-bd71-e55db1b02ffb admin admin] PATH_INFO: `/v3/projects/cef3a1f22bbb43d0b3a80f3e2bdd6fca/users/77f81748c0db4ef9802f2c736709bb56/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:44.370475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 869/1757] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:44 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:24:44.374237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29e92-820a-4d5b-9fa8-233f70693a77 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:44.393217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc800d-abfa-4c95-bd71-e55db1b02ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef3a1f22bbb43d0b3a80f3e2bdd6fca, user_id=77f81748c0db4ef9802f2c736709bb56, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:44.417065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc800d-abfa-4c95-bd71-e55db1b02ffb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:44.472144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 889/1758] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:44 2022] PUT /identity/v3/projects/cef3a1f22bbb43d0b3a80f3e2bdd6fca/users/77f81748c0db4ef9802f2c736709bb56/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:44.477533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc800d-abfa-4c95-bd71-e55db1b02ffb admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:44.661161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29e92-820a-4d5b-9fa8-233f70693a77 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:44.810032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc800d-abfa-4c95-bd71-e55db1b02ffb admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:44.838923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9d1db-8d22-44f2-9493-2920756bd622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:44.839707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9d1db-8d22-44f2-9493-2920756bd622 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:44.839996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9d1db-8d22-44f2-9493-2920756bd622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:44.840360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9d1db-8d22-44f2-9493-2920756bd622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:44.854624 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9d1db-8d22-44f2-9493-2920756bd622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:44.856373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9d1db-8d22-44f2-9493-2920756bd622 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:44.900771 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 890/1759] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:44.902213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9d1db-8d22-44f2-9493-2920756bd622 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:44.954465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9d1db-8d22-44f2-9493-2920756bd622 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:44.957209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4555d-0122-496a-9704-cab8b68bf68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:44.957931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4555d-0122-496a-9704-cab8b68bf68f admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:44.958433 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4555d-0122-496a-9704-cab8b68bf68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:44.958881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4555d-0122-496a-9704-cab8b68bf68f admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:44.959733 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4555d-0122-496a-9704-cab8b68bf68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:44.964758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4555d-0122-496a-9704-cab8b68bf68f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:44.969932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43ed93-2b48-4101-996e-3626108b6df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:44.975777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43ed93-2b48-4101-996e-3626108b6df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:44.979421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43ed93-2b48-4101-996e-3626108b6df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:44.979845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43ed93-2b48-4101-996e-3626108b6df1 admin admin] PATH_INFO: `/v3/projects/cef3a1f22bbb43d0b3a80f3e2bdd6fca/users/77f81748c0db4ef9802f2c736709bb56/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:44.987229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43ed93-2b48-4101-996e-3626108b6df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef3a1f22bbb43d0b3a80f3e2bdd6fca, user_id=77f81748c0db4ef9802f2c736709bb56, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:44.998401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43ed93-2b48-4101-996e-3626108b6df1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:45.032816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 870/1760] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:44 2022] POST /identity/v3/users => generated 293 bytes in 654 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:45.032816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4555d-0122-496a-9704-cab8b68bf68f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:45.062621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 891/1761] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:44 2022] PUT /identity/v3/projects/cef3a1f22bbb43d0b3a80f3e2bdd6fca/users/77f81748c0db4ef9802f2c736709bb56/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:45.064579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8092-0e13-4c6e-9730-eb32e80a6bbf None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:45.064875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8092-0e13-4c6e-9730-eb32e80a6bbf None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:45.065151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8092-0e13-4c6e-9730-eb32e80a6bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:45.077083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4555d-0122-496a-9704-cab8b68bf68f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:45.190288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f25e8092-0e13-4c6e-9730-eb32e80a6bbf None None] MFA Rules not processed for user `77f81748c0db4ef9802f2c736709bb56`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:45.191728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f25e8092-0e13-4c6e-9730-eb32e80a6bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:45.384099 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c846485-0658-4c5a-9787-4621ddb6bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:45.385020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c846485-0658-4c5a-9787-4621ddb6bca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:45.385177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c846485-0658-4c5a-9787-4621ddb6bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:45.385421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c846485-0658-4c5a-9787-4621ddb6bca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:45.386182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c846485-0658-4c5a-9787-4621ddb6bca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:45.387973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c846485-0658-4c5a-9787-4621ddb6bca2 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:45.438742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 892/1762] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:45.444646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 871/1763] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:45.455937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8092-0e13-4c6e-9730-eb32e80a6bbf None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:45.464345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c846485-0658-4c5a-9787-4621ddb6bca2 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:45.469459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3c846485-0658-4c5a-9787-4621ddb6bca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:45.502903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8092-0e13-4c6e-9730-eb32e80a6bbf None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:45.519915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6bdd8-0a97-4910-a895-147f80afc5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:45.524458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6bdd8-0a97-4910-a895-147f80afc5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:45.526521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6bdd8-0a97-4910-a895-147f80afc5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:45.527120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6bdd8-0a97-4910-a895-147f80afc5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:45.529623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6bdd8-0a97-4910-a895-147f80afc5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:45.541671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6bdd8-0a97-4910-a895-147f80afc5ec admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:45.563975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 893/1764] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:45.569438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6bdd8-0a97-4910-a895-147f80afc5ec admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:45.594992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6bdd8-0a97-4910-a895-147f80afc5ec admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:45.609723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaaa5c-24b9-451d-a2ea-e77088b1445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:45.611051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaa5c-24b9-451d-a2ea-e77088b1445b admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:45.611337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaa5c-24b9-451d-a2ea-e77088b1445b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:45.612137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaa5c-24b9-451d-a2ea-e77088b1445b admin admin] PATH_INFO: `/v3/projects/c7310162e9ce4721a4d41bbb96a59af7/users/9167144cfefe4c03935e0421190fb025/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:45.646669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaaa5c-24b9-451d-a2ea-e77088b1445b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7310162e9ce4721a4d41bbb96a59af7, user_id=9167144cfefe4c03935e0421190fb025, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:45.661820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaaa5c-24b9-451d-a2ea-e77088b1445b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:45.665846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c846485-0658-4c5a-9787-4621ddb6bca2 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:45.672794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f669d4-401c-49cf-bb34-1c642da1d5d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:45.673658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f669d4-401c-49cf-bb34-1c642da1d5d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:45.674035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f669d4-401c-49cf-bb34-1c642da1d5d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:45.674518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f669d4-401c-49cf-bb34-1c642da1d5d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:45.692214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f669d4-401c-49cf-bb34-1c642da1d5d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:45.694826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f669d4-401c-49cf-bb34-1c642da1d5d2 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:45.710470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 894/1765] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:45 2022] PUT /identity/v3/projects/c7310162e9ce4721a4d41bbb96a59af7/users/9167144cfefe4c03935e0421190fb025/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:45.712435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020120-c64b-44fe-80af-19a5dbf2d0d9 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:45.712713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020120-c64b-44fe-80af-19a5dbf2d0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:45.712992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020120-c64b-44fe-80af-19a5dbf2d0d9 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:45.717249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 895/1766] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:24:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:24:45.722031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912692a-11f9-4103-95fe-fd3fa0368166 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:45.722351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912692a-11f9-4103-95fe-fd3fa0368166 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:45.722635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912692a-11f9-4103-95fe-fd3fa0368166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:45.725021 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 872/1767] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:45.803910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-6912692a-11f9-4103-95fe-fd3fa0368166 None None] MFA Rules not processed for user `9167144cfefe4c03935e0421190fb025`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:45.805424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6912692a-11f9-4103-95fe-fd3fa0368166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:45.927083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2996249-fd3d-4c57-8564-f3cb368a2e5e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:45.927843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2996249-fd3d-4c57-8564-f3cb368a2e5e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:45.929356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2996249-fd3d-4c57-8564-f3cb368a2e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:45.999838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 896/1768] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:24:46.001103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912692a-11f9-4103-95fe-fd3fa0368166 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:46.002642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-c2996249-fd3d-4c57-8564-f3cb368a2e5e None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:46.009547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c2996249-fd3d-4c57-8564-f3cb368a2e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:46.179532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912692a-11f9-4103-95fe-fd3fa0368166 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:46.199927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b54dd-efb8-4b8a-8459-bc39ba04dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:46.200941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b54dd-efb8-4b8a-8459-bc39ba04dc9d admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:46.205211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b54dd-efb8-4b8a-8459-bc39ba04dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:46.205757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b54dd-efb8-4b8a-8459-bc39ba04dc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:46.207185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b54dd-efb8-4b8a-8459-bc39ba04dc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:46.209307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b54dd-efb8-4b8a-8459-bc39ba04dc9d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:46.279921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 897/1769] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:45 2022] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:46.280855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b54dd-efb8-4b8a-8459-bc39ba04dc9d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:46.349376 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 873/1770] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:24:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:46.421302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2996249-fd3d-4c57-8564-f3cb368a2e5e None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:46.423750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c2996249-fd3d-4c57-8564-f3cb368a2e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:46.430477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b54dd-efb8-4b8a-8459-bc39ba04dc9d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:46.450160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4b4ba-8f81-488e-b7bc-cc5c62b60e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:46.450370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4b4ba-8f81-488e-b7bc-cc5c62b60e52 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:46.450798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4b4ba-8f81-488e-b7bc-cc5c62b60e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:46.451346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4b4ba-8f81-488e-b7bc-cc5c62b60e52 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:46.452563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4b4ba-8f81-488e-b7bc-cc5c62b60e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:46.455049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4b4ba-8f81-488e-b7bc-cc5c62b60e52 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:46.471074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2996249-fd3d-4c57-8564-f3cb368a2e5e None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:46.525643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 898/1771] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:46 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:24:46.533950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4b4ba-8f81-488e-b7bc-cc5c62b60e52 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:46.553619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4b4ba-8f81-488e-b7bc-cc5c62b60e52 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:46.576710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e83d6-bbe3-497c-8ab6-3d4f4b85bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:46.577934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e83d6-bbe3-497c-8ab6-3d4f4b85bf18 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:46.577934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e83d6-bbe3-497c-8ab6-3d4f4b85bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:46.578214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e83d6-bbe3-497c-8ab6-3d4f4b85bf18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:46.579163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e83d6-bbe3-497c-8ab6-3d4f4b85bf18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:46.581360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e83d6-bbe3-497c-8ab6-3d4f4b85bf18 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:46.613805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 899/1772] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:24:46.623188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e83d6-bbe3-497c-8ab6-3d4f4b85bf18 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:46.648343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e83d6-bbe3-497c-8ab6-3d4f4b85bf18 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:46.656944 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeed731-4e64-41f7-9ebc-0be116f2d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:46.657768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41a25f-2419-47e4-a74a-9f28d3f8f990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:46.658246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeed731-4e64-41f7-9ebc-0be116f2d2de admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:46.658685 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41a25f-2419-47e4-a74a-9f28d3f8f990 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:46.658809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeed731-4e64-41f7-9ebc-0be116f2d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:46.659421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41a25f-2419-47e4-a74a-9f28d3f8f990 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:46.659644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeed731-4e64-41f7-9ebc-0be116f2d2de admin admin] PATH_INFO: `/v3/projects/0d789c79cc7642738195ef43f6128b6c/users/0e65c3ce962e4db39a2f4fa27ff5379e/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:46.660945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41a25f-2419-47e4-a74a-9f28d3f8f990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:46.681465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41a25f-2419-47e4-a74a-9f28d3f8f990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:46.683749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41a25f-2419-47e4-a74a-9f28d3f8f990 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:46.697486 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeed731-4e64-41f7-9ebc-0be116f2d2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d789c79cc7642738195ef43f6128b6c, user_id=0e65c3ce962e4db39a2f4fa27ff5379e, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:46.700872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeed731-4e64-41f7-9ebc-0be116f2d2de admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:46.703862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 874/1773] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:46.731325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 900/1774] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:46 2022] PUT /identity/v3/projects/0d789c79cc7642738195ef43f6128b6c/users/0e65c3ce962e4db39a2f4fa27ff5379e/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:46.735456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41a25f-2419-47e4-a74a-9f28d3f8f990 service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:46.752652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41a25f-2419-47e4-a74a-9f28d3f8f990 service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:46.781173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeed731-4e64-41f7-9ebc-0be116f2d2de admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:46.884388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8507cbb-a5a1-4b0c-9a41-2c90ca78064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:46.885075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8507cbb-a5a1-4b0c-9a41-2c90ca78064e admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:46.885358 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8507cbb-a5a1-4b0c-9a41-2c90ca78064e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:46.885657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8507cbb-a5a1-4b0c-9a41-2c90ca78064e admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:46.892238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8507cbb-a5a1-4b0c-9a41-2c90ca78064e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:46.902648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8507cbb-a5a1-4b0c-9a41-2c90ca78064e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:46.931496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeed731-4e64-41f7-9ebc-0be116f2d2de admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:46.938185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 875/1775] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:24:46.941883 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fd96c-9f97-4f3f-846c-4dd112724d3e tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f81748c0db4ef9802f2c736709bb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cef3a1f22bbb43d0b3a80f3e2bdd6fca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:46.943497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fd96c-9f97-4f3f-846c-4dd112724d3e tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:46.943904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fd96c-9f97-4f3f-846c-4dd112724d3e tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:46.944857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fd96c-9f97-4f3f-846c-4dd112724d3e tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:46.945740 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fd96c-9f97-4f3f-846c-4dd112724d3e tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:46.946217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fd96c-9f97-4f3f-846c-4dd112724d3e tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:46.948160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fd96c-9f97-4f3f-846c-4dd112724d3e tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:46.948521 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8507cbb-a5a1-4b0c-9a41-2c90ca78064e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:46.977430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 901/1776] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:24:46.980730 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fd96c-9f97-4f3f-846c-4dd112724d3e tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:46.986934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8507cbb-a5a1-4b0c-9a41-2c90ca78064e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:46.997603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fd96c-9f97-4f3f-846c-4dd112724d3e tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:47.001588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f111c6-899f-4884-abb6-4ce7cdbfd0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:47.003570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f111c6-899f-4884-abb6-4ce7cdbfd0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.004064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f111c6-899f-4884-abb6-4ce7cdbfd0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.005078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f111c6-899f-4884-abb6-4ce7cdbfd0ec admin admin] PATH_INFO: `/v3/projects/0d789c79cc7642738195ef43f6128b6c/users/0e65c3ce962e4db39a2f4fa27ff5379e/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.023727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f111c6-899f-4884-abb6-4ce7cdbfd0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d789c79cc7642738195ef43f6128b6c, user_id=0e65c3ce962e4db39a2f4fa27ff5379e, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:47.029289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f111c6-899f-4884-abb6-4ce7cdbfd0ec admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:47.037327 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625220e-1617-4249-9c85-11e248fd314d tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f81748c0db4ef9802f2c736709bb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cef3a1f22bbb43d0b3a80f3e2bdd6fca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:47.039832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625220e-1617-4249-9c85-11e248fd314d tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.040514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625220e-1617-4249-9c85-11e248fd314d tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.040895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625220e-1617-4249-9c85-11e248fd314d tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.043700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625220e-1617-4249-9c85-11e248fd314d tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:47.045709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625220e-1617-4249-9c85-11e248fd314d tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:47.064618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 876/1777] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:46 2022] PUT /identity/v3/projects/0d789c79cc7642738195ef43f6128b6c/users/0e65c3ce962e4db39a2f4fa27ff5379e/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:47.066570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93a4a5-5c43-4fe0-9794-fd62906eea3a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.066783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93a4a5-5c43-4fe0-9794-fd62906eea3a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.071642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93a4a5-5c43-4fe0-9794-fd62906eea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.101815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 902/1778] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:46 2022] POST /identity/v3/projects => generated 354 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:47.111442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625220e-1617-4249-9c85-11e248fd314d tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:47.116957 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6625220e-1617-4249-9c85-11e248fd314d tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:47.136145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-fe93a4a5-5c43-4fe0-9794-fd62906eea3a None None] MFA Rules not processed for user `0e65c3ce962e4db39a2f4fa27ff5379e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:47.141489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fe93a4a5-5c43-4fe0-9794-fd62906eea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:47.236588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625220e-1617-4249-9c85-11e248fd314d tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:47.244389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:47.245431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.245751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.246088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] PATH_INFO: `/v3/users/de406a5b5462463386dafaeee504db0a` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.247660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=de406a5b5462463386dafaeee504db0a)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:47.250220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:47.270209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 877/1779] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:47.283749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93a4a5-5c43-4fe0-9794-fd62906eea3a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:47.340357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de406a5b5462463386dafaeee504db0a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:47.349659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de406a5b5462463386dafaeee504db0a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:47.361001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de406a5b5462463386dafaeee504db0a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:47.361631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de406a5b5462463386dafaeee504db0a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:47.362419 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de406a5b5462463386dafaeee504db0a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:47.399728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 903/1780] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:47 2022] DELETE /identity/v3/users/de406a5b5462463386dafaeee504db0a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:47.401734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:47.403968 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:47.419002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93a4a5-5c43-4fe0-9794-fd62906eea3a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:47.527151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a394330-c434-4173-b5d7-0676d3ae57bb admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:47.542303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bcc5c-b951-4c9e-900c-9d8fe3d0ecca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:47.543212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bcc5c-b951-4c9e-900c-9d8fe3d0ecca service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.543764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bcc5c-b951-4c9e-900c-9d8fe3d0ecca service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.544203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bcc5c-b951-4c9e-900c-9d8fe3d0ecca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.547490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d50b6a-37b7-4ba0-93f2-c07086cbb48f tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f81748c0db4ef9802f2c736709bb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cef3a1f22bbb43d0b3a80f3e2bdd6fca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:47.548042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7a6bcc5c-b951-4c9e-900c-9d8fe3d0ecca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:47.548378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d50b6a-37b7-4ba0-93f2-c07086cbb48f tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.548902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d50b6a-37b7-4ba0-93f2-c07086cbb48f tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.549289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d50b6a-37b7-4ba0-93f2-c07086cbb48f tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.550227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d50b6a-37b7-4ba0-93f2-c07086cbb48f tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:47.550647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d50b6a-37b7-4ba0-93f2-c07086cbb48f tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:47.552402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d50b6a-37b7-4ba0-93f2-c07086cbb48f tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:47.565950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 878/1781] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:47.567491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a583e1-2405-4ebb-9997-9bde4310362e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.567895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a583e1-2405-4ebb-9997-9bde4310362e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.568191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a583e1-2405-4ebb-9997-9bde4310362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.614876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-61a583e1-2405-4ebb-9997-9bde4310362e None None] MFA Rules not processed for user `719425608bc4447ea2f433e12ebbb180`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:47.616784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-61a583e1-2405-4ebb-9997-9bde4310362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:47.686825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bcc5c-b951-4c9e-900c-9d8fe3d0ecca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:47.689469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bcc5c-b951-4c9e-900c-9d8fe3d0ecca service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:47.701581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 879/1782] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:47.702072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 904/1783] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:47.703557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb99aa-84f5-4cae-8193-25c138a9c14b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.704000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace7561-fe0e-4584-80e7-6af4de0c2273 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.704156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb99aa-84f5-4cae-8193-25c138a9c14b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.704582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb99aa-84f5-4cae-8193-25c138a9c14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.704778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace7561-fe0e-4584-80e7-6af4de0c2273 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.705157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace7561-fe0e-4584-80e7-6af4de0c2273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.728320 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bace7561-fe0e-4584-80e7-6af4de0c2273 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:47.729690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bace7561-fe0e-4584-80e7-6af4de0c2273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:47.734774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d9bb99aa-84f5-4cae-8193-25c138a9c14b None None] MFA Rules not processed for user `9dbdadbe21e542dcb1c3dad9d67e8a92`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:47.736197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d9bb99aa-84f5-4cae-8193-25c138a9c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:47.868127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 880/1784] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:47.869744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a19e5-ee27-448a-b0a4-1e2c0439b18a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.870310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a19e5-ee27-448a-b0a4-1e2c0439b18a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.871027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a19e5-ee27-448a-b0a4-1e2c0439b18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.925166 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 905/1785] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:47.925747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb99aa-84f5-4cae-8193-25c138a9c14b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:47.926748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d79a19e5-ee27-448a-b0a4-1e2c0439b18a None None] MFA Rules not processed for user `8fe99bd37b184bf3b5e78602ab0073fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:47.928734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d9bb99aa-84f5-4cae-8193-25c138a9c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:47.939087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d79a19e5-ee27-448a-b0a4-1e2c0439b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:47.954369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb99aa-84f5-4cae-8193-25c138a9c14b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:47.971829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:47.972739 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:47.973026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:47.973305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] PATH_INFO: `/v3/users/12771bb265f744a4bfd13ac8a819670a` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:47.981741 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=12771bb265f744a4bfd13ac8a819670a)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:47.984113 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:48.076207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 881/1786] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:48.082936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a19e5-ee27-448a-b0a4-1e2c0439b18a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:48.091935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d79a19e5-ee27-448a-b0a4-1e2c0439b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:48.095176 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12771bb265f744a4bfd13ac8a819670a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.112132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12771bb265f744a4bfd13ac8a819670a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.120217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a19e5-ee27-448a-b0a4-1e2c0439b18a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:48.126461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f81748c0db4ef9802f2c736709bb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cef3a1f22bbb43d0b3a80f3e2bdd6fca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:48.127726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:48.128579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:48.129431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] PATH_INFO: `/v3/projects/a785c163bfb54378ad0127397f5672a2` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:48.130442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12771bb265f744a4bfd13ac8a819670a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.131083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a785c163bfb54378ad0127397f5672a2)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:48.131396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12771bb265f744a4bfd13ac8a819670a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.132840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12771bb265f744a4bfd13ac8a819670a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.134789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:48.170869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 906/1787] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:47 2022] DELETE /identity/v3/users/12771bb265f744a4bfd13ac8a819670a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:48.176047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:48.195531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:48.198723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a785c163bfb54378ad0127397f5672a2', 'request_id': 'req-39bb6516-3913-4d23-9b5e-40e52b124a47'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.207806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a785c163bfb54378ad0127397f5672a2', 'request_id': 'req-39bb6516-3913-4d23-9b5e-40e52b124a47'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.224064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a785c163bfb54378ad0127397f5672a2', 'request_id': 'req-39bb6516-3913-4d23-9b5e-40e52b124a47'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.249740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] The token cache is being invalidate because project a785c163bfb54378ad0127397f5672a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:48.250337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.251451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.258144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 882/1788] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:48 2022] DELETE /identity/v3/projects/a785c163bfb54378ad0127397f5672a2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:48.258144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:48.258893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:48.335973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714978c5-9a0d-4b21-97c3-c289540fd2fe admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:48.434692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6516-3913-4d23-9b5e-40e52b124a47 tempest-VolumeQuotaClassesTest-659610459 tempest-VolumeQuotaClassesTest-659610459-project-admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:48.458952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:48.466760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:48.467326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:48.467779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] PATH_INFO: `/v3/users/9167144cfefe4c03935e0421190fb025` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:48.469541 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9167144cfefe4c03935e0421190fb025)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:48.472045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:48.488723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:48.489655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:48.489655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:48.489953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:48.496057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:48.583036 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:48.585476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:48.596835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 907/1789] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:48.597586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:48.599057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:48.618352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9167144cfefe4c03935e0421190fb025'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.636393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9167144cfefe4c03935e0421190fb025'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.638532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9167144cfefe4c03935e0421190fb025'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.659630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9167144cfefe4c03935e0421190fb025'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.667930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d260bab-cd68-462d-b588-21702863f1c8 service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:48.672222 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d616db-ded1-4718-af84-e88b6bee54f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:48.672582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d616db-ded1-4718-af84-e88b6bee54f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:48.672980 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d616db-ded1-4718-af84-e88b6bee54f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:48.673287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d616db-ded1-4718-af84-e88b6bee54f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:48.675880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c3d616db-ded1-4718-af84-e88b6bee54f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:48.693529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d616db-ded1-4718-af84-e88b6bee54f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:48.693947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3cd79325-6c20-4a4f-aeac-47a4ee8bf0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9167144cfefe4c03935e0421190fb025'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:48.696954 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d616db-ded1-4718-af84-e88b6bee54f3 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:48.711857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 883/1790] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:48 2022] DELETE /identity/v3/users/9167144cfefe4c03935e0421190fb025 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:48.713198 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7163ae-94ea-4955-b7f3-ca842eebaa60 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:48.713492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7163ae-94ea-4955-b7f3-ca842eebaa60 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:48.713772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7163ae-94ea-4955-b7f3-ca842eebaa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:48.730123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 908/1791] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:48.732558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9d90b-2b3e-42fe-9431-68ede5ee3f13 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:48.732969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9d90b-2b3e-42fe-9431-68ede5ee3f13 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:48.736241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9d90b-2b3e-42fe-9431-68ede5ee3f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:48.749539 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3d7163ae-94ea-4955-b7f3-ca842eebaa60 None None] MFA Rules not processed for user `8fe99bd37b184bf3b5e78602ab0073fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:48.751067 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3d7163ae-94ea-4955-b7f3-ca842eebaa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:48.825597 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-96c9d90b-2b3e-42fe-9431-68ede5ee3f13 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:48.830078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-96c9d90b-2b3e-42fe-9431-68ede5ee3f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:48.855027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 884/1792] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:48.856472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf659b-f049-427d-9fc5-219dc424dc1d None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:48.856767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf659b-f049-427d-9fc5-219dc424dc1d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:48.857062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf659b-f049-427d-9fc5-219dc424dc1d None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:48.869403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 885/1793] 10.222.0.16 () {54 vars in 912 bytes} [Thu Mar 10 17:24:48 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:24:48.871014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431b0db-a6cc-4410-945a-c35c0649fc7b None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:48.871314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431b0db-a6cc-4410-945a-c35c0649fc7b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:48.871899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431b0db-a6cc-4410-945a-c35c0649fc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:48.931043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3431b0db-a6cc-4410-945a-c35c0649fc7b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:48.932310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3431b0db-a6cc-4410-945a-c35c0649fc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.036884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 909/1794] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:49.038293 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9d90b-2b3e-42fe-9431-68ede5ee3f13 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:49.044418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-96c9d90b-2b3e-42fe-9431-68ede5ee3f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.072638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9d90b-2b3e-42fe-9431-68ede5ee3f13 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:49.075252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 886/1795] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:49.077666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a12d-8ca4-4537-883d-b4b133eb3ee2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:49.078378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a12d-8ca4-4537-883d-b4b133eb3ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:49.078378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a12d-8ca4-4537-883d-b4b133eb3ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:49.088333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:49.089470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:49.089470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:49.089775 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] PATH_INFO: `/v3/users/29d5ade0b0204ccda4b6fbbdb9356c48` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:49.092256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d5ade0b0204ccda4b6fbbdb9356c48)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:49.094306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:49.119212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e464a12d-8ca4-4537-883d-b4b133eb3ee2 None None] MFA Rules not processed for user `701c0e43cc30442582456f4f7153333a`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:49.120437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e464a12d-8ca4-4537-883d-b4b133eb3ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.188488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d5ade0b0204ccda4b6fbbdb9356c48'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:49.204610 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d5ade0b0204ccda4b6fbbdb9356c48'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:49.219580 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 887/1796] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:49.222554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d5ade0b0204ccda4b6fbbdb9356c48'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:49.222982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a12d-8ca4-4537-883d-b4b133eb3ee2 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:49.224170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d5ade0b0204ccda4b6fbbdb9356c48'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:49.224962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d5ade0b0204ccda4b6fbbdb9356c48'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:49.227415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e464a12d-8ca4-4537-883d-b4b133eb3ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.253700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a12d-8ca4-4537-883d-b4b133eb3ee2 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:49.260801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 910/1797] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:49 2022] DELETE /identity/v3/users/29d5ade0b0204ccda4b6fbbdb9356c48 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:49.261815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:49.267098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.414186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3492133-1787-425c-b0ec-0107e49367e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:49.414871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3492133-1787-425c-b0ec-0107e49367e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:49.415242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3492133-1787-425c-b0ec-0107e49367e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:49.415440 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3492133-1787-425c-b0ec-0107e49367e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:49.428503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c3492133-1787-425c-b0ec-0107e49367e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.480615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b3d9c-ac66-43f9-842e-748ed2409074 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:49.492108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a443306-2183-426f-9cad-804a7fdbbb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:49.493055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a443306-2183-426f-9cad-804a7fdbbb46 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:49.493345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a443306-2183-426f-9cad-804a7fdbbb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:49.493621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a443306-2183-426f-9cad-804a7fdbbb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:49.506369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6a443306-2183-426f-9cad-804a7fdbbb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.624221 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3492133-1787-425c-b0ec-0107e49367e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:49.625992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3492133-1787-425c-b0ec-0107e49367e9 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:49.645433 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 888/1798] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:49.648644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3492133-1787-425c-b0ec-0107e49367e9 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:49.670136 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3492133-1787-425c-b0ec-0107e49367e9 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:49.675508 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a443306-2183-426f-9cad-804a7fdbbb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:49.679208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:49.679888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:49.680177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:49.680467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:49.686297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a443306-2183-426f-9cad-804a7fdbbb46 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:49.686501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.700593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 911/1799] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:49.701953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d3778-fc0d-48d2-acee-dd2cb782e71d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:49.702276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d3778-fc0d-48d2-acee-dd2cb782e71d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:49.702559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d3778-fc0d-48d2-acee-dd2cb782e71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:49.708095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:49.711188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:49.729616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 889/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:49.743972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a59d3778-fc0d-48d2-acee-dd2cb782e71d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:49.745594 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a59d3778-fc0d-48d2-acee-dd2cb782e71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.764755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 912/1801] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:49.822950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:49.824508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:49.846664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d3778-fc0d-48d2-acee-dd2cb782e71d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:49.857941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57050234-8120-4173-bc50-85eb1301179c service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:49.868188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d3778-fc0d-48d2-acee-dd2cb782e71d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:49.876555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:49.877474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:49.879368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:49.881150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433da8c-9fa2-447b-89b8-87dd9417af16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:49.881288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] PATH_INFO: `/v3/projects/90ef0bed623b449fb88beea7cb6029a8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:49.882085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433da8c-9fa2-447b-89b8-87dd9417af16 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:49.884702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433da8c-9fa2-447b-89b8-87dd9417af16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:49.885084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433da8c-9fa2-447b-89b8-87dd9417af16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:49.886392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ef0bed623b449fb88beea7cb6029a8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:49.893220 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:49.921829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433da8c-9fa2-447b-89b8-87dd9417af16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:49.923574 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433da8c-9fa2-447b-89b8-87dd9417af16 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:49.956647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 913/1802] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:50.072496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ef0bed623b449fb88beea7cb6029a8', 'request_id': 'req-06165b83-e9b8-4b7a-823e-bce44c491799'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.083192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ef0bed623b449fb88beea7cb6029a8', 'request_id': 'req-06165b83-e9b8-4b7a-823e-bce44c491799'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.095759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ef0bed623b449fb88beea7cb6029a8', 'request_id': 'req-06165b83-e9b8-4b7a-823e-bce44c491799'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.113204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] The token cache is being invalidate because project 90ef0bed623b449fb88beea7cb6029a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:50.113668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.114735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.121316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 890/1803] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:49 2022] DELETE /identity/v3/projects/90ef0bed623b449fb88beea7cb6029a8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:50.122540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433da8c-9fa2-447b-89b8-87dd9417af16 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:50.133397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433da8c-9fa2-447b-89b8-87dd9417af16 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:50.338918 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:50.340533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:50.340886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:50.341216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] PATH_INFO: `/v3/users/3fbff7c4dde8456cb2a5f33defcf8cf4` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:50.343496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbff7c4dde8456cb2a5f33defcf8cf4)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:50.346836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:50.427184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbff7c4dde8456cb2a5f33defcf8cf4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.455155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbff7c4dde8456cb2a5f33defcf8cf4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.468749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbff7c4dde8456cb2a5f33defcf8cf4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.469942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbff7c4dde8456cb2a5f33defcf8cf4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.470233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbff7c4dde8456cb2a5f33defcf8cf4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:50.540945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 914/1804] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:50 2022] DELETE /identity/v3/users/3fbff7c4dde8456cb2a5f33defcf8cf4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:24:50.968804 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:50.970458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:51.148070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06165b83-e9b8-4b7a-823e-bce44c491799 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:51.279810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:51.280333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:51.281251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:51.281447 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:51.282958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:51.283396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:51.286793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:51.427433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8405-b5a0-4c60-98f8-badd812073eb admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:51.440123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:51.441651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:51.443372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:51.444652 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] PATH_INFO: `/v3/projects/70d9e99c491a430eb9c73576877d896e` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:51.451437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d9e99c491a430eb9c73576877d896e)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:51.453409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:51.501255 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:51.504220 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:51.549405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d9e99c491a430eb9c73576877d896e', 'request_id': 'req-68efd05d-4f03-4a06-af43-0915f6c263a1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:51.549835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 891/1805] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:51.550830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:51.557177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:51.565402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d9e99c491a430eb9c73576877d896e', 'request_id': 'req-68efd05d-4f03-4a06-af43-0915f6c263a1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:51.580080 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d9e99c491a430eb9c73576877d896e', 'request_id': 'req-68efd05d-4f03-4a06-af43-0915f6c263a1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:51.596409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] The token cache is being invalidate because project 70d9e99c491a430eb9c73576877d896e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:51.597183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:51.598319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-68efd05d-4f03-4a06-af43-0915f6c263a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:51.601259 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 915/1806] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:51 2022] DELETE /identity/v3/projects/70d9e99c491a430eb9c73576877d896e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:24:51.606577 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b7ad-65d6-47e9-9f32-bc723bb717c7 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:51.607133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b7ad-65d6-47e9-9f32-bc723bb717c7 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:51.607610 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b7ad-65d6-47e9-9f32-bc723bb717c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:51.611684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53cd03-50c5-40c6-be69-3261c9615f88 service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:51.649580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-cbf7b7ad-65d6-47e9-9f32-bc723bb717c7 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:51.651358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-cbf7b7ad-65d6-47e9-9f32-bc723bb717c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:51.749759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 916/1807] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:51.758608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64bb08-bbb2-45ca-8ae0-84c1dfe17749 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:51.759079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64bb08-bbb2-45ca-8ae0-84c1dfe17749 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:51.759530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64bb08-bbb2-45ca-8ae0-84c1dfe17749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:51.841456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-dc64bb08-bbb2-45ca-8ae0-84c1dfe17749 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:51.842248 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:51.845515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:51.845810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:51.846092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] PATH_INFO: `/v3/projects/1e29f6dc4c1247e4821ccf0bc3e3a01e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:51.850386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-dc64bb08-bbb2-45ca-8ae0-84c1dfe17749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:51.869535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e29f6dc4c1247e4821ccf0bc3e3a01e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:51.877107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:51.904816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 917/1808] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:51.911833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64bb08-bbb2-45ca-8ae0-84c1dfe17749 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:51.913745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-dc64bb08-bbb2-45ca-8ae0-84c1dfe17749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:51.968648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64bb08-bbb2-45ca-8ae0-84c1dfe17749 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:51.990762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:51.994583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:51.994863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:51.995140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] PATH_INFO: `/v3/projects/c7310162e9ce4721a4d41bbb96a59af7` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:52.001634 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7310162e9ce4721a4d41bbb96a59af7)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:52.020388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:52.106642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e29f6dc4c1247e4821ccf0bc3e3a01e', 'request_id': 'req-d507c2bd-1350-419f-ac52-fdc4404ef963'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.119594 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7310162e9ce4721a4d41bbb96a59af7', 'request_id': 'req-c23e468e-344f-4d7e-9598-d3d092560088'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.121206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e29f6dc4c1247e4821ccf0bc3e3a01e', 'request_id': 'req-d507c2bd-1350-419f-ac52-fdc4404ef963'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.136747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e29f6dc4c1247e4821ccf0bc3e3a01e', 'request_id': 'req-d507c2bd-1350-419f-ac52-fdc4404ef963'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.144122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7310162e9ce4721a4d41bbb96a59af7', 'request_id': 'req-c23e468e-344f-4d7e-9598-d3d092560088'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.171315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7310162e9ce4721a4d41bbb96a59af7', 'request_id': 'req-c23e468e-344f-4d7e-9598-d3d092560088'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.180654 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] The token cache is being invalidate because project 1e29f6dc4c1247e4821ccf0bc3e3a01e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:52.181595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.184633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.201129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 892/1809] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:51 2022] DELETE /identity/v3/projects/1e29f6dc4c1247e4821ccf0bc3e3a01e => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:52.203270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:52.208499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:52.223840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] The token cache is being invalidate because project c7310162e9ce4721a4d41bbb96a59af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:52.224145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.229795 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.240572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 918/1810] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:51 2022] DELETE /identity/v3/projects/c7310162e9ce4721a4d41bbb96a59af7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:52.243234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:52.263639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:52.394751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507c2bd-1350-419f-ac52-fdc4404ef963 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:52.404857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:52.405774 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:52.406439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:52.407012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:52.407926 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:52.408391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:52.409444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e468e-344f-4d7e-9598-d3d092560088 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:52.410991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:52.428168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 893/1811] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:52.429594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:52.434561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:52.435476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:52.436972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:52.437429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:52.437858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] PATH_INFO: `/v3/projects/95cad6dc5f3a480b9b5ec3be620c01dc` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:52.439692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cad6dc5f3a480b9b5ec3be620c01dc)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:52.441918 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:52.463761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59309bc-a481-4f65-8907-77bc50b0ccb7 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:52.487345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:52.488284 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:52.488572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:52.488852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] PATH_INFO: `/v3/users/77f81748c0db4ef9802f2c736709bb56` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:52.497951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f81748c0db4ef9802f2c736709bb56)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:52.499842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:52.538314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cad6dc5f3a480b9b5ec3be620c01dc', 'request_id': 'req-4c606905-96b8-4b3a-be1c-8c8b04327e5e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.548102 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cad6dc5f3a480b9b5ec3be620c01dc', 'request_id': 'req-4c606905-96b8-4b3a-be1c-8c8b04327e5e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.557987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cad6dc5f3a480b9b5ec3be620c01dc', 'request_id': 'req-4c606905-96b8-4b3a-be1c-8c8b04327e5e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.573018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] The token cache is being invalidate because project 95cad6dc5f3a480b9b5ec3be620c01dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:52.573867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.574686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.576611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 919/1812] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:52 2022] DELETE /identity/v3/projects/95cad6dc5f3a480b9b5ec3be620c01dc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:52.580971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:52.582609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:52.596510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f81748c0db4ef9802f2c736709bb56'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.612382 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f81748c0db4ef9802f2c736709bb56'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.613108 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f81748c0db4ef9802f2c736709bb56'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.623485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f81748c0db4ef9802f2c736709bb56'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.647530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f81748c0db4ef9802f2c736709bb56'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:52.661559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 894/1813] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:52 2022] DELETE /identity/v3/users/77f81748c0db4ef9802f2c736709bb56 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:52.662553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:52.666413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:52.682160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c606905-96b8-4b3a-be1c-8c8b04327e5e admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:52.808345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8b375-e7c2-4597-b5ed-33726eb74dc5 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:52.821814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba747a-d98a-4c44-b02d-7773093fc70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:52.824436 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba747a-d98a-4c44-b02d-7773093fc70f admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:52.824734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba747a-d98a-4c44-b02d-7773093fc70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:52.825018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba747a-d98a-4c44-b02d-7773093fc70f admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:52.839254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba747a-d98a-4c44-b02d-7773093fc70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:52.839254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba747a-d98a-4c44-b02d-7773093fc70f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:52.885818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:52.889437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:52.892449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:52.892764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] PATH_INFO: `/v3/users/0e65c3ce962e4db39a2f4fa27ff5379e` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:52.900234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e65c3ce962e4db39a2f4fa27ff5379e)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:52.906298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:52.924892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 895/1814] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:52 2022] POST /identity/v3/projects => generated 369 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:52.926417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa0df-8366-46ed-8617-27ead70df1b6 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:52.926714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa0df-8366-46ed-8617-27ead70df1b6 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:52.926995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa0df-8366-46ed-8617-27ead70df1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.000891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2b5aa0df-8366-46ed-8617-27ead70df1b6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:53.003608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2b5aa0df-8366-46ed-8617-27ead70df1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:53.011598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e65c3ce962e4db39a2f4fa27ff5379e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:53.026007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e65c3ce962e4db39a2f4fa27ff5379e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:53.046054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e65c3ce962e4db39a2f4fa27ff5379e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:53.048974 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e65c3ce962e4db39a2f4fa27ff5379e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:53.049745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5fdb2556-dc1c-4768-bdd7-af10dae40fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e65c3ce962e4db39a2f4fa27ff5379e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:53.120803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 896/1815] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:53.127792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aa0df-8366-46ed-8617-27ead70df1b6 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:53.127792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2b5aa0df-8366-46ed-8617-27ead70df1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:53.133041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 920/1816] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:24:52 2022] DELETE /identity/v3/users/0e65c3ce962e4db39a2f4fa27ff5379e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:53.137959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f363e8b-eb44-4579-be08-1059f173fcd9 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:53.139433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f363e8b-eb44-4579-be08-1059f173fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:53.141237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f363e8b-eb44-4579-be08-1059f173fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.159417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aa0df-8366-46ed-8617-27ead70df1b6 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:53.182592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4f363e8b-eb44-4579-be08-1059f173fcd9 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:53.185541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4f363e8b-eb44-4579-be08-1059f173fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:53.326926 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0875876-72a9-4ea1-a1d9-75fa685ed441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:53.328528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875876-72a9-4ea1-a1d9-75fa685ed441 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:53.329054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875876-72a9-4ea1-a1d9-75fa685ed441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:53.329533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875876-72a9-4ea1-a1d9-75fa685ed441 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.330483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0875876-72a9-4ea1-a1d9-75fa685ed441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:53.332719 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0875876-72a9-4ea1-a1d9-75fa685ed441 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:53.356336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 921/1817] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:53.357491 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90db1a6-539f-43cb-a65c-d7f9bb92b4db None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:53.357799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90db1a6-539f-43cb-a65c-d7f9bb92b4db None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:53.358088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90db1a6-539f-43cb-a65c-d7f9bb92b4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.364938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 897/1818] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:53 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:53.364938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0875876-72a9-4ea1-a1d9-75fa685ed441 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:53.375197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0875876-72a9-4ea1-a1d9-75fa685ed441 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:53.380147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0714a-9938-4c8f-8f51-4eebe53a9272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:53.381343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0714a-9938-4c8f-8f51-4eebe53a9272 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:53.381343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0714a-9938-4c8f-8f51-4eebe53a9272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:53.382418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0714a-9938-4c8f-8f51-4eebe53a9272 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.383315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0714a-9938-4c8f-8f51-4eebe53a9272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:53.383729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0714a-9938-4c8f-8f51-4eebe53a9272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:53.386140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0714a-9938-4c8f-8f51-4eebe53a9272 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:53.401400 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 898/1819] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:53.402657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0714a-9938-4c8f-8f51-4eebe53a9272 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:53.412790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a90db1a6-539f-43cb-a65c-d7f9bb92b4db None None] MFA Rules not processed for user `8fe99bd37b184bf3b5e78602ab0073fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:53.415609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0714a-9938-4c8f-8f51-4eebe53a9272 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:53.417260 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a90db1a6-539f-43cb-a65c-d7f9bb92b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:53.423059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d0fb2-0bd1-4db6-bf8d-8b5facab7f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:53.423888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d0fb2-0bd1-4db6-bf8d-8b5facab7f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:53.424390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d0fb2-0bd1-4db6-bf8d-8b5facab7f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:53.424803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d0fb2-0bd1-4db6-bf8d-8b5facab7f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.425944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d0fb2-0bd1-4db6-bf8d-8b5facab7f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:53.428209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d0fb2-0bd1-4db6-bf8d-8b5facab7f8d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:53.451557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 899/1820] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:53.452480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d0fb2-0bd1-4db6-bf8d-8b5facab7f8d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:53.500802 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d0fb2-0bd1-4db6-bf8d-8b5facab7f8d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:53.526567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf70cff-5689-4261-af47-58a94b16ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:53.530464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf70cff-5689-4261-af47-58a94b16ca45 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:53.533123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf70cff-5689-4261-af47-58a94b16ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:53.534813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf70cff-5689-4261-af47-58a94b16ca45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.535716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf70cff-5689-4261-af47-58a94b16ca45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:53.551125 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf70cff-5689-4261-af47-58a94b16ca45 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:53.581810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 922/1821] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:53.583893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90db1a6-539f-43cb-a65c-d7f9bb92b4db None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:53.623284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90db1a6-539f-43cb-a65c-d7f9bb92b4db None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:53.654983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0557-0cb5-4fc5-80fe-780becea872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:53.655681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0557-0cb5-4fc5-80fe-780becea872e admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:53.655966 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0557-0cb5-4fc5-80fe-780becea872e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:53.656252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0557-0cb5-4fc5-80fe-780becea872e admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.656985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf0557-0cb5-4fc5-80fe-780becea872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:53.663143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf0557-0cb5-4fc5-80fe-780becea872e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:53.670405 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 900/1822] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:53 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:53.676464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf70cff-5689-4261-af47-58a94b16ca45 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:53.711947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 923/1823] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:53.718774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0557-0cb5-4fc5-80fe-780becea872e admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:53.722940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-decf0557-0cb5-4fc5-80fe-780becea872e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:53.756255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0557-0cb5-4fc5-80fe-780becea872e admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:53.862135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf70cff-5689-4261-af47-58a94b16ca45 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:53.868922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:53.869778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:53.870070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:53.870427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] PATH_INFO: `/v3/projects/cef3a1f22bbb43d0b3a80f3e2bdd6fca` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.871927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef3a1f22bbb43d0b3a80f3e2bdd6fca)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:53.875049 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034ee04-1ccb-4e60-b287-02d028877e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:53.875175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:53.875791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034ee04-1ccb-4e60-b287-02d028877e1f admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:53.877597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034ee04-1ccb-4e60-b287-02d028877e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:53.877937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034ee04-1ccb-4e60-b287-02d028877e1f admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:53.880222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034ee04-1ccb-4e60-b287-02d028877e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:53.884195 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034ee04-1ccb-4e60-b287-02d028877e1f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:53.932903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 901/1824] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:53 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:53.934602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034ee04-1ccb-4e60-b287-02d028877e1f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:53.961873 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034ee04-1ccb-4e60-b287-02d028877e1f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:53.978251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef3a1f22bbb43d0b3a80f3e2bdd6fca', 'request_id': 'req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:53.993603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef3a1f22bbb43d0b3a80f3e2bdd6fca', 'request_id': 'req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:54.008115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef3a1f22bbb43d0b3a80f3e2bdd6fca', 'request_id': 'req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:54.033091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] The token cache is being invalidate because project cef3a1f22bbb43d0b3a80f3e2bdd6fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:54.033391 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:54.037744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5bbb0db1-d8cf-47cb-9e3c-15ba293e12e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:54.041512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 924/1825] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:53 2022] DELETE /identity/v3/projects/cef3a1f22bbb43d0b3a80f3e2bdd6fca => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:54.043105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec645f-9e9d-4843-b38d-d3d877170665 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.043393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec645f-9e9d-4843-b38d-d3d877170665 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.043674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec645f-9e9d-4843-b38d-d3d877170665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.093077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-b2ec645f-9e9d-4843-b38d-d3d877170665 None None] MFA Rules not processed for user `719425608bc4447ea2f433e12ebbb180`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:54.094489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b2ec645f-9e9d-4843-b38d-d3d877170665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.143214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b601b9-1213-4362-b881-cdcbc24606be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:54.145694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b601b9-1213-4362-b881-cdcbc24606be admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.147680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b601b9-1213-4362-b881-cdcbc24606be admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.148956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b601b9-1213-4362-b881-cdcbc24606be admin admin] PATH_INFO: `/v3/projects/b7ecd25c41a146719a8cd39f444b050c/users/3909e739cc8848fc8d6273c8f2a4f9e8/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.201615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b601b9-1213-4362-b881-cdcbc24606be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ecd25c41a146719a8cd39f444b050c, user_id=3909e739cc8848fc8d6273c8f2a4f9e8, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:54.204352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b601b9-1213-4362-b881-cdcbc24606be admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:54.232204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 925/1826] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:54.233119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec645f-9e9d-4843-b38d-d3d877170665 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:54.237399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b2ec645f-9e9d-4843-b38d-d3d877170665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.254164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 902/1827] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:53 2022] PUT /identity/v3/projects/b7ecd25c41a146719a8cd39f444b050c/users/3909e739cc8848fc8d6273c8f2a4f9e8/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:54.257126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6d164-5135-4f7b-bb2e-84d7d74dfa0e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.257581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6d164-5135-4f7b-bb2e-84d7d74dfa0e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.258009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6d164-5135-4f7b-bb2e-84d7d74dfa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.276266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec645f-9e9d-4843-b38d-d3d877170665 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:54.308729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-c8b6d164-5135-4f7b-bb2e-84d7d74dfa0e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:54.310577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c8b6d164-5135-4f7b-bb2e-84d7d74dfa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.433271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5852c34-0faf-4895-b37f-f3af3203d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:54.433719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5852c34-0faf-4895-b37f-f3af3203d551 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.434003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5852c34-0faf-4895-b37f-f3af3203d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.434312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5852c34-0faf-4895-b37f-f3af3203d551 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.435258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5852c34-0faf-4895-b37f-f3af3203d551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:54.437664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5852c34-0faf-4895-b37f-f3af3203d551 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:54.460749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 926/1828] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:54.465128 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d981a7a-a425-498a-9970-d5026507479d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.465488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d981a7a-a425-498a-9970-d5026507479d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.465688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d981a7a-a425-498a-9970-d5026507479d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.489253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 903/1829] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:54.490306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6d164-5135-4f7b-bb2e-84d7d74dfa0e None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:54.492029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c8b6d164-5135-4f7b-bb2e-84d7d74dfa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.508083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6d164-5135-4f7b-bb2e-84d7d74dfa0e None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:54.520832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9d981a7a-a425-498a-9970-d5026507479d None None] MFA Rules not processed for user `3909e739cc8848fc8d6273c8f2a4f9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:54.522866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9d981a7a-a425-498a-9970-d5026507479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.523314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:54.530420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.530739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.531035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] PATH_INFO: `/v3/projects/0d789c79cc7642738195ef43f6128b6c` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.545489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d789c79cc7642738195ef43f6128b6c)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:54.554455 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:54.618564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 927/1830] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:54.619732 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d981a7a-a425-498a-9970-d5026507479d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:54.634373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d981a7a-a425-498a-9970-d5026507479d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:54.635378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d789c79cc7642738195ef43f6128b6c', 'request_id': 'req-b411b67a-122d-49aa-a251-2662ef8fe438'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:54.642687 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d789c79cc7642738195ef43f6128b6c', 'request_id': 'req-b411b67a-122d-49aa-a251-2662ef8fe438'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:54.656345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d789c79cc7642738195ef43f6128b6c', 'request_id': 'req-b411b67a-122d-49aa-a251-2662ef8fe438'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:54.683957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] The token cache is being invalidate because project 0d789c79cc7642738195ef43f6128b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:24:54.684549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:54.685468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b411b67a-122d-49aa-a251-2662ef8fe438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:24:54.693815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 904/1831] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:24:54 2022] DELETE /identity/v3/projects/0d789c79cc7642738195ef43f6128b6c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:54.698537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab674128-51fa-4b58-b060-e4c3285cab46 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.698827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab674128-51fa-4b58-b060-e4c3285cab46 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.699109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab674128-51fa-4b58-b060-e4c3285cab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.759481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ab674128-51fa-4b58-b060-e4c3285cab46 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:54.760874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ab674128-51fa-4b58-b060-e4c3285cab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.768600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6f934-16ba-4318-8f42-d9e291e3ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:54.769296 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f934-16ba-4318-8f42-d9e291e3ce77 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.769582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f934-16ba-4318-8f42-d9e291e3ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.769864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f934-16ba-4318-8f42-d9e291e3ce77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.770631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6f934-16ba-4318-8f42-d9e291e3ce77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:54.772275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6f934-16ba-4318-8f42-d9e291e3ce77 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:54.780431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 905/1832] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:54.781291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab674128-51fa-4b58-b060-e4c3285cab46 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:54.784301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ab674128-51fa-4b58-b060-e4c3285cab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.798801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 928/1833] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:54.800011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926bc30-a2f0-421f-a06e-333955c0d79c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.800308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926bc30-a2f0-421f-a06e-333955c0d79c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.800592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926bc30-a2f0-421f-a06e-333955c0d79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.835501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4926bc30-a2f0-421f-a06e-333955c0d79c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:54.840689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4926bc30-a2f0-421f-a06e-333955c0d79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.863588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 929/1834] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:54.864862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926bc30-a2f0-421f-a06e-333955c0d79c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:54.890534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926bc30-a2f0-421f-a06e-333955c0d79c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:54.902813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:54.903501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.903789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.904070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.904805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:54.905114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:54.906910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:54.921134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab674128-51fa-4b58-b060-e4c3285cab46 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:54.925899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 930/1835] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:54.926373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40ca3a-7def-4744-a0e0-6a148299f1f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9a11df2d3d4dc292a5115de69bb288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:54.927026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:54.927134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ca3a-7def-4744-a0e0-6a148299f1f1 service glance] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.927424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ca3a-7def-4744-a0e0-6a148299f1f1 service glance] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.927721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ca3a-7def-4744-a0e0-6a148299f1f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:54.929827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.931266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0e40ca3a-7def-4744-a0e0-6a148299f1f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:54.947275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a75cd-6533-4c44-bfc2-942a10c80d94 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:54.952540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769b208-8cd2-4d3f-8fac-c03a0d350223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:54.953459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769b208-8cd2-4d3f-8fac-c03a0d350223 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:54.953748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769b208-8cd2-4d3f-8fac-c03a0d350223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:54.954027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769b208-8cd2-4d3f-8fac-c03a0d350223 admin admin] PATH_INFO: `/v3/projects/02c02438a1bf4945860816fa7b853e76/users/080cc44adbcd4a4eb6062fa6005506ed/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.034734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769b208-8cd2-4d3f-8fac-c03a0d350223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c02438a1bf4945860816fa7b853e76, user_id=080cc44adbcd4a4eb6062fa6005506ed, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.042074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769b208-8cd2-4d3f-8fac-c03a0d350223 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.058988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40ca3a-7def-4744-a0e0-6a148299f1f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.061408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40ca3a-7def-4744-a0e0-6a148299f1f1 service glance] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.074156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 931/1836] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:54 2022] PUT /identity/v3/projects/02c02438a1bf4945860816fa7b853e76/users/080cc44adbcd4a4eb6062fa6005506ed/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:55.074156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651e86-d2c0-4870-aac9-33cce874490a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.074156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651e86-d2c0-4870-aac9-33cce874490a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.074156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651e86-d2c0-4870-aac9-33cce874490a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.076572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 906/1837] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:55.077731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40ca3a-7def-4744-a0e0-6a148299f1f1 service glance] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.095866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40ca3a-7def-4744-a0e0-6a148299f1f1 service glance] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:55.168047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-30651e86-d2c0-4870-aac9-33cce874490a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:55.169570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-30651e86-d2c0-4870-aac9-33cce874490a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:55.169795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6198-c54d-46b6-9d5f-b39dd3961a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:55.170756 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6198-c54d-46b6-9d5f-b39dd3961a8e admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.171690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6198-c54d-46b6-9d5f-b39dd3961a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.172633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6198-c54d-46b6-9d5f-b39dd3961a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.173544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c6198-c54d-46b6-9d5f-b39dd3961a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.175926 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c6198-c54d-46b6-9d5f-b39dd3961a8e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.204929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 932/1838] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:55.206292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5de28-6f8a-4db0-8e46-cc8d12f7ca94 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.206532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5de28-6f8a-4db0-8e46-cc8d12f7ca94 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.206813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5de28-6f8a-4db0-8e46-cc8d12f7ca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.221879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 907/1839] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:55 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:55.222954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6198-c54d-46b6-9d5f-b39dd3961a8e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.302846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6198-c54d-46b6-9d5f-b39dd3961a8e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:55.318726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ef1e9-dedf-4fa2-9f33-a176b0cc926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:55.318923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-91e5de28-6f8a-4db0-8e46-cc8d12f7ca94 None None] MFA Rules not processed for user `080cc44adbcd4a4eb6062fa6005506ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:55.319723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ef1e9-dedf-4fa2-9f33-a176b0cc926f admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.320002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-91e5de28-6f8a-4db0-8e46-cc8d12f7ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:55.320184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ef1e9-dedf-4fa2-9f33-a176b0cc926f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.321932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ef1e9-dedf-4fa2-9f33-a176b0cc926f admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.322331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ef1e9-dedf-4fa2-9f33-a176b0cc926f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:24:55.322732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ef1e9-dedf-4fa2-9f33-a176b0cc926f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.324379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ef1e9-dedf-4fa2-9f33-a176b0cc926f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.358392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 908/1840] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:24:55.358392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ef1e9-dedf-4fa2-9f33-a176b0cc926f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.371691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ef1e9-dedf-4fa2-9f33-a176b0cc926f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:55.381595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934b751-6a3c-41f0-b717-4fdfa5ba4709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:55.383922 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934b751-6a3c-41f0-b717-4fdfa5ba4709 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.384214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934b751-6a3c-41f0-b717-4fdfa5ba4709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.384498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934b751-6a3c-41f0-b717-4fdfa5ba4709 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.385204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934b751-6a3c-41f0-b717-4fdfa5ba4709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.392251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934b751-6a3c-41f0-b717-4fdfa5ba4709 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.468392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 909/1841] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:55 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:55.468392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934b751-6a3c-41f0-b717-4fdfa5ba4709 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.491769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934b751-6a3c-41f0-b717-4fdfa5ba4709 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:55.501290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bcc79-ccd2-493c-a19d-41d7ea702bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:55.501981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bcc79-ccd2-493c-a19d-41d7ea702bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.502296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bcc79-ccd2-493c-a19d-41d7ea702bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.502583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bcc79-ccd2-493c-a19d-41d7ea702bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.507260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bcc79-ccd2-493c-a19d-41d7ea702bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.509223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bcc79-ccd2-493c-a19d-41d7ea702bb3 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.531659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 933/1842] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:55.532625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5de28-6f8a-4db0-8e46-cc8d12f7ca94 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.548999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5de28-6f8a-4db0-8e46-cc8d12f7ca94 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:55.567423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369760b9-ff70-4e19-9972-56d541d7f652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:55.568252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369760b9-ff70-4e19-9972-56d541d7f652 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.568453 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369760b9-ff70-4e19-9972-56d541d7f652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.568693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369760b9-ff70-4e19-9972-56d541d7f652 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.569467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369760b9-ff70-4e19-9972-56d541d7f652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.571105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369760b9-ff70-4e19-9972-56d541d7f652 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.588791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 910/1843] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:55 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:55.589665 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bcc79-ccd2-493c-a19d-41d7ea702bb3 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.601493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 934/1844] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:55.608710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369760b9-ff70-4e19-9972-56d541d7f652 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.638501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369760b9-ff70-4e19-9972-56d541d7f652 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:55.713788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bcc79-ccd2-493c-a19d-41d7ea702bb3 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:55.721606 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c2112-e335-42bc-a9b5-cf16120aaadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:55.722473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c2112-e335-42bc-a9b5-cf16120aaadd admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.723620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c2112-e335-42bc-a9b5-cf16120aaadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.724047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c2112-e335-42bc-a9b5-cf16120aaadd admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.724956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c2112-e335-42bc-a9b5-cf16120aaadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.727853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c2112-e335-42bc-a9b5-cf16120aaadd admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.774481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 911/1845] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:55 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:55.774481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c2112-e335-42bc-a9b5-cf16120aaadd admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.828772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8aa6d-0176-4730-aeb8-e8f5e5340107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:55.830348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8aa6d-0176-4730-aeb8-e8f5e5340107 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.830650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8aa6d-0176-4730-aeb8-e8f5e5340107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.831733 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8aa6d-0176-4730-aeb8-e8f5e5340107 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.832754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8aa6d-0176-4730-aeb8-e8f5e5340107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.835487 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8aa6d-0176-4730-aeb8-e8f5e5340107 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.923938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c2112-e335-42bc-a9b5-cf16120aaadd admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:55.936344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 935/1846] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:55 2022] POST /identity/v3/users => generated 296 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:55.937564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8aa6d-0176-4730-aeb8-e8f5e5340107 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.941160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2056f8-6e21-409d-8c6a-5a954b91908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:55.941866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2056f8-6e21-409d-8c6a-5a954b91908e admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:55.942420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2056f8-6e21-409d-8c6a-5a954b91908e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:55.942856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2056f8-6e21-409d-8c6a-5a954b91908e admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:55.944135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2056f8-6e21-409d-8c6a-5a954b91908e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:55.946809 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2056f8-6e21-409d-8c6a-5a954b91908e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:55.978592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8aa6d-0176-4730-aeb8-e8f5e5340107 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:55.982406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 912/1847] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:55.983434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2056f8-6e21-409d-8c6a-5a954b91908e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:55.999525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cabfc-add1-491c-89aa-fbe389775c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:56.000494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cabfc-add1-491c-89aa-fbe389775c5a admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.000916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cabfc-add1-491c-89aa-fbe389775c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.001339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cabfc-add1-491c-89aa-fbe389775c5a admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.002555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cabfc-add1-491c-89aa-fbe389775c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:56.004840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cabfc-add1-491c-89aa-fbe389775c5a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:56.011516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2056f8-6e21-409d-8c6a-5a954b91908e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:56.027595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89140a-43a6-44c6-973d-2be567e9a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:56.028445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89140a-43a6-44c6-973d-2be567e9a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.028811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89140a-43a6-44c6-973d-2be567e9a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.030450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89140a-43a6-44c6-973d-2be567e9a8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.031351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89140a-43a6-44c6-973d-2be567e9a8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:56.036131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89140a-43a6-44c6-973d-2be567e9a8fc admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:56.048225 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 936/1848] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:55 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:56.049314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cabfc-add1-491c-89aa-fbe389775c5a admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:56.068989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 913/1849] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:56.068989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89140a-43a6-44c6-973d-2be567e9a8fc admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:56.073626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cabfc-add1-491c-89aa-fbe389775c5a admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:56.080592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb9978-dc15-4d78-8a71-46ae8a2f8d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:56.082077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb9978-dc15-4d78-8a71-46ae8a2f8d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.086476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb9978-dc15-4d78-8a71-46ae8a2f8d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.086826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb9978-dc15-4d78-8a71-46ae8a2f8d8a admin admin] PATH_INFO: `/v3/projects/641027cfc5444bcb8b0d29c0b4ddee8b/users/32cc1ae0a00945789330308da436888b/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.110487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89140a-43a6-44c6-973d-2be567e9a8fc admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:56.112076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb9978-dc15-4d78-8a71-46ae8a2f8d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=641027cfc5444bcb8b0d29c0b4ddee8b, user_id=32cc1ae0a00945789330308da436888b, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:56.115177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb9978-dc15-4d78-8a71-46ae8a2f8d8a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:56.120005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15ce9a-d059-42c8-a89e-adce3572f6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:56.121040 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15ce9a-d059-42c8-a89e-adce3572f6ad admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.121466 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15ce9a-d059-42c8-a89e-adce3572f6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.121934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15ce9a-d059-42c8-a89e-adce3572f6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.123048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15ce9a-d059-42c8-a89e-adce3572f6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:56.126943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15ce9a-d059-42c8-a89e-adce3572f6ad admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:56.144343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 937/1850] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:56 2022] PUT /identity/v3/projects/641027cfc5444bcb8b0d29c0b4ddee8b/users/32cc1ae0a00945789330308da436888b/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:56.145757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb9978-dc15-4d78-8a71-46ae8a2f8d8a admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:56.154305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 914/1851] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:56.155816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c7b1-27e3-48de-8b7a-45b9aa361739 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.158728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c7b1-27e3-48de-8b7a-45b9aa361739 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.159296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c7b1-27e3-48de-8b7a-45b9aa361739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.232106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9234c7b1-27e3-48de-8b7a-45b9aa361739 None None] MFA Rules not processed for user `32cc1ae0a00945789330308da436888b`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:56.233952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9234c7b1-27e3-48de-8b7a-45b9aa361739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:56.245666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb9978-dc15-4d78-8a71-46ae8a2f8d8a admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:56.252663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3ac4-09af-4d23-9ad3-a9468d0537f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:56.253404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3ac4-09af-4d23-9ad3-a9468d0537f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.253793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3ac4-09af-4d23-9ad3-a9468d0537f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.254002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3ac4-09af-4d23-9ad3-a9468d0537f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.254945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3ac4-09af-4d23-9ad3-a9468d0537f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:56.257381 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3ac4-09af-4d23-9ad3-a9468d0537f4 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:56.269410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 938/1852] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:56.274445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3ac4-09af-4d23-9ad3-a9468d0537f4 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:56.298562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3ac4-09af-4d23-9ad3-a9468d0537f4 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:56.309201 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24874ff-c208-4749-9b18-cb1623a92849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:56.310081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24874ff-c208-4749-9b18-cb1623a92849 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.310534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24874ff-c208-4749-9b18-cb1623a92849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.311013 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24874ff-c208-4749-9b18-cb1623a92849 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.311910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24874ff-c208-4749-9b18-cb1623a92849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:56.323418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24874ff-c208-4749-9b18-cb1623a92849 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:56.360578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 939/1853] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:56.364242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24874ff-c208-4749-9b18-cb1623a92849 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:56.390990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24874ff-c208-4749-9b18-cb1623a92849 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:56.398251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0201818-9110-4db3-824a-425e58d81587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:56.399696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0201818-9110-4db3-824a-425e58d81587 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.400223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0201818-9110-4db3-824a-425e58d81587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.400756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0201818-9110-4db3-824a-425e58d81587 admin admin] PATH_INFO: `/v3/projects/4fcf85ebcbed41dd9db7ab4f9db95b64/users/a22121663c53439e97f4ce45ac2236bb/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.412356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 915/1854] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:56.412356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234c7b1-27e3-48de-8b7a-45b9aa361739 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:56.423543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0201818-9110-4db3-824a-425e58d81587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fcf85ebcbed41dd9db7ab4f9db95b64, user_id=a22121663c53439e97f4ce45ac2236bb, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:56.427070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0201818-9110-4db3-824a-425e58d81587 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:56.436085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234c7b1-27e3-48de-8b7a-45b9aa361739 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:56.449216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d859d8-c6fd-4b72-944f-bc5266c22d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:56.450147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d859d8-c6fd-4b72-944f-bc5266c22d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.450444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d859d8-c6fd-4b72-944f-bc5266c22d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.450727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d859d8-c6fd-4b72-944f-bc5266c22d0c admin admin] PATH_INFO: `/v3/projects/db59566083a14b4fb91b721fee99b7d5/users/d9d456c07a704d13abbb4522f2b0e12e/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.451250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 940/1855] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:56 2022] PUT /identity/v3/projects/4fcf85ebcbed41dd9db7ab4f9db95b64/users/a22121663c53439e97f4ce45ac2236bb/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:56.452975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0201818-9110-4db3-824a-425e58d81587 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:56.495691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d859d8-c6fd-4b72-944f-bc5266c22d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db59566083a14b4fb91b721fee99b7d5, user_id=d9d456c07a704d13abbb4522f2b0e12e, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:56.498608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d859d8-c6fd-4b72-944f-bc5266c22d0c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:56.516374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 916/1856] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:56 2022] PUT /identity/v3/projects/db59566083a14b4fb91b721fee99b7d5/users/d9d456c07a704d13abbb4522f2b0e12e/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:56.518422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba935-5be0-4697-850f-62fea869e422 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.518422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba935-5be0-4697-850f-62fea869e422 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.518422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba935-5be0-4697-850f-62fea869e422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.585458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-88dba935-5be0-4697-850f-62fea869e422 None None] MFA Rules not processed for user `a22121663c53439e97f4ce45ac2236bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:56.587573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-88dba935-5be0-4697-850f-62fea869e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:56.665098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0201818-9110-4db3-824a-425e58d81587 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:56.795988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684149ed-2828-4b32-a70f-1a4625f69651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:56.797048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684149ed-2828-4b32-a70f-1a4625f69651 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.797545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684149ed-2828-4b32-a70f-1a4625f69651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.798261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684149ed-2828-4b32-a70f-1a4625f69651 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.799299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684149ed-2828-4b32-a70f-1a4625f69651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:56.802190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684149ed-2828-4b32-a70f-1a4625f69651 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:56.816308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 917/1857] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:56.822472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f39ff-64f3-4741-bf75-73b4182197ff None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.823170 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f39ff-64f3-4741-bf75-73b4182197ff None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.823796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f39ff-64f3-4741-bf75-73b4182197ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.874295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 941/1858] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:56 2022] POST /identity/v3/projects => generated 381 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:56.879034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753500-7988-4029-8bc7-a2f7e704a5a4 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:56.879641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753500-7988-4029-8bc7-a2f7e704a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:56.882780 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753500-7988-4029-8bc7-a2f7e704a5a4 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:56.890654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 942/1859] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:24:56 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:24:56.892284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753500-7988-4029-8bc7-a2f7e704a5a4 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:56.959885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-5b6f39ff-64f3-4741-bf75-73b4182197ff None None] MFA Rules not processed for user `d9d456c07a704d13abbb4522f2b0e12e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:56.961301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5b6f39ff-64f3-4741-bf75-73b4182197ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:57.124489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753500-7988-4029-8bc7-a2f7e704a5a4 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.136462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 918/1860] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:57.136924 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1252ce-4d45-4478-b29c-cb01afc326cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.137989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f39ff-64f3-4741-bf75-73b4182197ff None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.139354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1252ce-4d45-4478-b29c-cb01afc326cb admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.139657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1252ce-4d45-4478-b29c-cb01afc326cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.139941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1252ce-4d45-4478-b29c-cb01afc326cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.140651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1252ce-4d45-4478-b29c-cb01afc326cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.154570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1252ce-4d45-4478-b29c-cb01afc326cb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.157787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f39ff-64f3-4741-bf75-73b4182197ff None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.165181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e867a2d-0519-4100-a803-28e720283394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.166000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e867a2d-0519-4100-a803-28e720283394 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.167201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e867a2d-0519-4100-a803-28e720283394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.167576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e867a2d-0519-4100-a803-28e720283394 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.168369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e867a2d-0519-4100-a803-28e720283394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.177939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e867a2d-0519-4100-a803-28e720283394 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.198632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 943/1861] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:56 2022] POST /identity/v3/projects => generated 391 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:57.200504 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59925da9-e622-47fc-b688-183b03ec53d1 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.201000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59925da9-e622-47fc-b688-183b03ec53d1 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.201699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59925da9-e622-47fc-b688-183b03ec53d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.224610 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 919/1862] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:57 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:57.225760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e867a2d-0519-4100-a803-28e720283394 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.231635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-59925da9-e622-47fc-b688-183b03ec53d1 None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:57.234483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-59925da9-e622-47fc-b688-183b03ec53d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:57.236849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e867a2d-0519-4100-a803-28e720283394 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.346389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7b207-6b96-4fa0-81e0-9e533e3546c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.347096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7b207-6b96-4fa0-81e0-9e533e3546c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.348233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7b207-6b96-4fa0-81e0-9e533e3546c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.348532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7b207-6b96-4fa0-81e0-9e533e3546c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.349250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7b207-6b96-4fa0-81e0-9e533e3546c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.352201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7b207-6b96-4fa0-81e0-9e533e3546c6 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.356305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 944/1863] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:24:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:57.358060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59925da9-e622-47fc-b688-183b03ec53d1 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.371828 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59925da9-e622-47fc-b688-183b03ec53d1 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.383909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 920/1864] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:24:57 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:57.384755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd8c7-ae65-4245-a580-9e382e7aca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.385054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7b207-6b96-4fa0-81e0-9e533e3546c6 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.385705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd8c7-ae65-4245-a580-9e382e7aca58 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.386062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd8c7-ae65-4245-a580-9e382e7aca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.386748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd8c7-ae65-4245-a580-9e382e7aca58 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.387712 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dd8c7-ae65-4245-a580-9e382e7aca58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.392498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dd8c7-ae65-4245-a580-9e382e7aca58 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.429110 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 945/1865] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:57 2022] POST /identity/v3/users => generated 302 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:57.430373 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd8c7-ae65-4245-a580-9e382e7aca58 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.463727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd8c7-ae65-4245-a580-9e382e7aca58 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.481754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256d86-c4a3-4336-a7e5-23e201645d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.484585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7b207-6b96-4fa0-81e0-9e533e3546c6 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.490009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d95ec4-7613-4272-8561-352d0c038bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.490341 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256d86-c4a3-4336-a7e5-23e201645d0e admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.490643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256d86-c4a3-4336-a7e5-23e201645d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.491478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d95ec4-7613-4272-8561-352d0c038bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.491584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256d86-c4a3-4336-a7e5-23e201645d0e admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.491774 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d95ec4-7613-4272-8561-352d0c038bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.492054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d95ec4-7613-4272-8561-352d0c038bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.492229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49256d86-c4a3-4336-a7e5-23e201645d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.493013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d95ec4-7613-4272-8561-352d0c038bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.494189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49256d86-c4a3-4336-a7e5-23e201645d0e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.494708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d95ec4-7613-4272-8561-352d0c038bc1 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.542990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 921/1866] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:57.544319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d95ec4-7613-4272-8561-352d0c038bc1 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.549833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 946/1867] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:24:57 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:24:57.549833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256d86-c4a3-4336-a7e5-23e201645d0e admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.564531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256d86-c4a3-4336-a7e5-23e201645d0e admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.567097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d95ec4-7613-4272-8561-352d0c038bc1 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.574456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc087224-d5d6-4949-ba31-a133e068841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.575366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087224-d5d6-4949-ba31-a133e068841f admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.575651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087224-d5d6-4949-ba31-a133e068841f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.575932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087224-d5d6-4949-ba31-a133e068841f admin admin] PATH_INFO: `/v3/projects/f4b80e9cfb2d45b2b4b6b2fdf145ebe1/users/15920ebff9a7400ea41eb793a8c6fc86/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.578905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b284a-047c-4d6e-8d68-e9a3af08573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.579870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b284a-047c-4d6e-8d68-e9a3af08573f admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.580161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b284a-047c-4d6e-8d68-e9a3af08573f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.580441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b284a-047c-4d6e-8d68-e9a3af08573f admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.581560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b284a-047c-4d6e-8d68-e9a3af08573f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.583347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b284a-047c-4d6e-8d68-e9a3af08573f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.593852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc087224-d5d6-4949-ba31-a133e068841f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b80e9cfb2d45b2b4b6b2fdf145ebe1, user_id=15920ebff9a7400ea41eb793a8c6fc86, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.595682 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 922/1868] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:57.596546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b284a-047c-4d6e-8d68-e9a3af08573f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.597888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc087224-d5d6-4949-ba31-a133e068841f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.612790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b284a-047c-4d6e-8d68-e9a3af08573f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.619280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 947/1869] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:57 2022] PUT /identity/v3/projects/f4b80e9cfb2d45b2b4b6b2fdf145ebe1/users/15920ebff9a7400ea41eb793a8c6fc86/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:57.619280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc087224-d5d6-4949-ba31-a133e068841f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.737413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc087224-d5d6-4949-ba31-a133e068841f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.744278 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd8ee9-1703-4003-9ed8-9307e8b80e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.744919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd8ee9-1703-4003-9ed8-9307e8b80e9c admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.745327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd8ee9-1703-4003-9ed8-9307e8b80e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.745454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd8ee9-1703-4003-9ed8-9307e8b80e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.746296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd8ee9-1703-4003-9ed8-9307e8b80e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.747949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd8ee9-1703-4003-9ed8-9307e8b80e9c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.752580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98da3e-6b67-4544-933c-15f0b48e3094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.753558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98da3e-6b67-4544-933c-15f0b48e3094 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.753933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98da3e-6b67-4544-933c-15f0b48e3094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.754275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98da3e-6b67-4544-933c-15f0b48e3094 admin admin] PATH_INFO: `/v3/projects/448e617f81ad4c99abf1a711fbc8f2ff/users/d324010403bf4f738a6f70ff099f127b/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.760918 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 923/1870] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:57.764680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd8ee9-1703-4003-9ed8-9307e8b80e9c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.788373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd8ee9-1703-4003-9ed8-9307e8b80e9c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.789958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98da3e-6b67-4544-933c-15f0b48e3094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448e617f81ad4c99abf1a711fbc8f2ff, user_id=d324010403bf4f738a6f70ff099f127b, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.792627 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98da3e-6b67-4544-933c-15f0b48e3094 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.800818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82febb9-9aa8-4782-adeb-2714453af531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.801458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82febb9-9aa8-4782-adeb-2714453af531 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.801745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82febb9-9aa8-4782-adeb-2714453af531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.802098 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82febb9-9aa8-4782-adeb-2714453af531 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.802862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82febb9-9aa8-4782-adeb-2714453af531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.805466 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82febb9-9aa8-4782-adeb-2714453af531 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.820877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 948/1871] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:57 2022] PUT /identity/v3/projects/448e617f81ad4c99abf1a711fbc8f2ff/users/d324010403bf4f738a6f70ff099f127b/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:57.821806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98da3e-6b67-4544-933c-15f0b48e3094 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.824713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6d98da3e-6b67-4544-933c-15f0b48e3094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:57.825654 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 924/1872] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:57.826771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82febb9-9aa8-4782-adeb-2714453af531 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:57.841197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82febb9-9aa8-4782-adeb-2714453af531 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.945527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98da3e-6b67-4544-933c-15f0b48e3094 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:57.954378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80999abc-f36b-4233-ab49-5254c7ea1518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.954975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79676ae-9f0c-450b-b6bd-cdbccff1b07d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:57.955622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80999abc-f36b-4233-ab49-5254c7ea1518 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.955903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80999abc-f36b-4233-ab49-5254c7ea1518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.956025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79676ae-9f0c-450b-b6bd-cdbccff1b07d service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:57.956931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79676ae-9f0c-450b-b6bd-cdbccff1b07d service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:57.957143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80999abc-f36b-4233-ab49-5254c7ea1518 admin admin] PATH_INFO: `/v3/projects/1f32d85526ca4b4297f2f2b5ea420a6b/users/e09e11c4740d4581983febed3a82fb26/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.957226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79676ae-9f0c-450b-b6bd-cdbccff1b07d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:57.969229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79676ae-9f0c-450b-b6bd-cdbccff1b07d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.971282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79676ae-9f0c-450b-b6bd-cdbccff1b07d service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.975718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80999abc-f36b-4233-ab49-5254c7ea1518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f32d85526ca4b4297f2f2b5ea420a6b, user_id=e09e11c4740d4581983febed3a82fb26, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:57.979155 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80999abc-f36b-4233-ab49-5254c7ea1518 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:57.987394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 949/1873] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:57.989242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79676ae-9f0c-450b-b6bd-cdbccff1b07d service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:58.008965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79676ae-9f0c-450b-b6bd-cdbccff1b07d service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:58.035770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 925/1874] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:57 2022] PUT /identity/v3/projects/1f32d85526ca4b4297f2f2b5ea420a6b/users/e09e11c4740d4581983febed3a82fb26/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:58.035770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80999abc-f36b-4233-ab49-5254c7ea1518 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:58.143742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80999abc-f36b-4233-ab49-5254c7ea1518 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:58.158503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc44e38-708e-4c33-a743-398c154ce31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:58.158852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc44e38-708e-4c33-a743-398c154ce31d admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.159806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc44e38-708e-4c33-a743-398c154ce31d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.160114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc44e38-708e-4c33-a743-398c154ce31d admin admin] PATH_INFO: `/v3/projects/f4b80e9cfb2d45b2b4b6b2fdf145ebe1/users/15920ebff9a7400ea41eb793a8c6fc86/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.163103 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc44e38-708e-4c33-a743-398c154ce31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b80e9cfb2d45b2b4b6b2fdf145ebe1, user_id=15920ebff9a7400ea41eb793a8c6fc86, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:58.165891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc44e38-708e-4c33-a743-398c154ce31d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:58.176181 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788ed29-6c72-4a96-b01a-573a96ba7347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:58.177756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788ed29-6c72-4a96-b01a-573a96ba7347 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.178047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788ed29-6c72-4a96-b01a-573a96ba7347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.178962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788ed29-6c72-4a96-b01a-573a96ba7347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.180222 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788ed29-6c72-4a96-b01a-573a96ba7347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:58.181821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788ed29-6c72-4a96-b01a-573a96ba7347 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:58.202674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 926/1875] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:58 2022] PUT /identity/v3/projects/f4b80e9cfb2d45b2b4b6b2fdf145ebe1/users/15920ebff9a7400ea41eb793a8c6fc86/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:58.203644 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc44e38-708e-4c33-a743-398c154ce31d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:58.223431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 950/1876] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:58.223431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63cde7-3eeb-4e66-b6a6-2cfd2873a300 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.223431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63cde7-3eeb-4e66-b6a6-2cfd2873a300 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.223431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63cde7-3eeb-4e66-b6a6-2cfd2873a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.341523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc44e38-708e-4c33-a743-398c154ce31d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:58.356262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280822ac-16c1-4524-8097-1f9609b4ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:58.357402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280822ac-16c1-4524-8097-1f9609b4ef60 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.357714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280822ac-16c1-4524-8097-1f9609b4ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.358000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280822ac-16c1-4524-8097-1f9609b4ef60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.359647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280822ac-16c1-4524-8097-1f9609b4ef60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:58.361624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280822ac-16c1-4524-8097-1f9609b4ef60 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:58.370509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4c63cde7-3eeb-4e66-b6a6-2cfd2873a300 None None] MFA Rules not processed for user `15920ebff9a7400ea41eb793a8c6fc86`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:58.372735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4c63cde7-3eeb-4e66-b6a6-2cfd2873a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:58.382264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 927/1877] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:24:58.386173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280822ac-16c1-4524-8097-1f9609b4ef60 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:58.404267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280822ac-16c1-4524-8097-1f9609b4ef60 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:58.410223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1b48-0650-4272-b177-b79e1d30a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:58.411589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1b48-0650-4272-b177-b79e1d30a897 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.412388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1b48-0650-4272-b177-b79e1d30a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.412847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1b48-0650-4272-b177-b79e1d30a897 admin admin] PATH_INFO: `/v3/projects/448e617f81ad4c99abf1a711fbc8f2ff/users/d324010403bf4f738a6f70ff099f127b/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.415170 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce1b48-0650-4272-b177-b79e1d30a897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448e617f81ad4c99abf1a711fbc8f2ff, user_id=d324010403bf4f738a6f70ff099f127b, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:58.421744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce1b48-0650-4272-b177-b79e1d30a897 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:58.442169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 928/1878] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:58 2022] PUT /identity/v3/projects/448e617f81ad4c99abf1a711fbc8f2ff/users/d324010403bf4f738a6f70ff099f127b/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:58.442169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1b48-0650-4272-b177-b79e1d30a897 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:58.525456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 951/1879] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:58.527372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465e39b-8089-46c4-a305-d15724776a10 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.527898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465e39b-8089-46c4-a305-d15724776a10 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.529357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465e39b-8089-46c4-a305-d15724776a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.592201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1b48-0650-4272-b177-b79e1d30a897 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:58.597760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97f3dc-5d45-4cd2-a14e-5f3de0e57927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:58.598749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d465e39b-8089-46c4-a305-d15724776a10 None None] MFA Rules not processed for user `d324010403bf4f738a6f70ff099f127b`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:58.599646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97f3dc-5d45-4cd2-a14e-5f3de0e57927 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.600730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97f3dc-5d45-4cd2-a14e-5f3de0e57927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.601019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97f3dc-5d45-4cd2-a14e-5f3de0e57927 admin admin] PATH_INFO: `/v3/projects/1f32d85526ca4b4297f2f2b5ea420a6b/users/e09e11c4740d4581983febed3a82fb26/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.603678 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97f3dc-5d45-4cd2-a14e-5f3de0e57927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f32d85526ca4b4297f2f2b5ea420a6b, user_id=e09e11c4740d4581983febed3a82fb26, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:58.605635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d465e39b-8089-46c4-a305-d15724776a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:58.606473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97f3dc-5d45-4cd2-a14e-5f3de0e57927 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:58.619578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 929/1880] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:24:58 2022] PUT /identity/v3/projects/1f32d85526ca4b4297f2f2b5ea420a6b/users/e09e11c4740d4581983febed3a82fb26/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:24:58.620457 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97f3dc-5d45-4cd2-a14e-5f3de0e57927 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:58.630730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9e97f3dc-5d45-4cd2-a14e-5f3de0e57927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:58.756291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97f3dc-5d45-4cd2-a14e-5f3de0e57927 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:58.760632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597c76-fd27-4d3f-b484-352d43cb4aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:58.761310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597c76-fd27-4d3f-b484-352d43cb4aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.761596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597c76-fd27-4d3f-b484-352d43cb4aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.761877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597c76-fd27-4d3f-b484-352d43cb4aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.771286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 952/1881] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:58.774031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307475a0-ecab-4a6f-bc07-5df8b2aaae73 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.774854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307475a0-ecab-4a6f-bc07-5df8b2aaae73 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.775245 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307475a0-ecab-4a6f-bc07-5df8b2aaae73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.812563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-307475a0-ecab-4a6f-bc07-5df8b2aaae73 None None] MFA Rules not processed for user `e09e11c4740d4581983febed3a82fb26`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:24:58.814018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-307475a0-ecab-4a6f-bc07-5df8b2aaae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:58.882020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48597c76-fd27-4d3f-b484-352d43cb4aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:58.883437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48597c76-fd27-4d3f-b484-352d43cb4aa5 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:58.901348 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 930/1882] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:58.915426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597c76-fd27-4d3f-b484-352d43cb4aa5 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:58.922502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-48597c76-fd27-4d3f-b484-352d43cb4aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:24:58.975550 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597c76-fd27-4d3f-b484-352d43cb4aa5 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:58.981738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18ac0-d6a3-4686-8047-f3b5c35d00a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:58.983366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18ac0-d6a3-4686-8047-f3b5c35d00a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:58.983749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18ac0-d6a3-4686-8047-f3b5c35d00a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:58.984038 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18ac0-d6a3-4686-8047-f3b5c35d00a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:58.986067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 953/1883] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:24:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:24:59.029130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307475a0-ecab-4a6f-bc07-5df8b2aaae73 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:59.044288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307475a0-ecab-4a6f-bc07-5df8b2aaae73 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:59.050622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3523b30-0658-4c9e-aeda-04fc2b4f89cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:59.051455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3523b30-0658-4c9e-aeda-04fc2b4f89cf service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:59.051811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3523b30-0658-4c9e-aeda-04fc2b4f89cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:59.052863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3523b30-0658-4c9e-aeda-04fc2b4f89cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:59.070286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3523b30-0658-4c9e-aeda-04fc2b4f89cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:59.072636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3523b30-0658-4c9e-aeda-04fc2b4f89cf service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:59.136983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18ac0-d6a3-4686-8047-f3b5c35d00a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:59.139199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18ac0-d6a3-4686-8047-f3b5c35d00a3 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:59.142882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 954/1884] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:24:59.157106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 931/1885] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:24:59.316613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3523b30-0658-4c9e-aeda-04fc2b4f89cf service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:24:59.328600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3523b30-0658-4c9e-aeda-04fc2b4f89cf service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:24:59.336427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f2224-e1fd-4daf-ad8a-87120d94706f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:24:59.337236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2224-e1fd-4daf-ad8a-87120d94706f service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:24:59.337877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2224-e1fd-4daf-ad8a-87120d94706f service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:24:59.340095 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2224-e1fd-4daf-ad8a-87120d94706f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:24:59.460640 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f2224-e1fd-4daf-ad8a-87120d94706f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:24:59.463761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f2224-e1fd-4daf-ad8a-87120d94706f service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:24:59.515423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 955/1886] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:24:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:00.178559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18ac0-d6a3-4686-8047-f3b5c35d00a3 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:00.188916 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18ac0-d6a3-4686-8047-f3b5c35d00a3 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:00.202491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e2ea0-ac8b-4464-9cb4-915c86974497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:00.203373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e2ea0-ac8b-4464-9cb4-915c86974497 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:00.203850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e2ea0-ac8b-4464-9cb4-915c86974497 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:00.204303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e2ea0-ac8b-4464-9cb4-915c86974497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:00.333107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e2ea0-ac8b-4464-9cb4-915c86974497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:00.334799 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e2ea0-ac8b-4464-9cb4-915c86974497 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:00.357230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 932/1887] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:00.464436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f2224-e1fd-4daf-ad8a-87120d94706f service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:00.593017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ab6d-593c-43cd-b6b5-1d0f64974053 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:00.593482 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ab6d-593c-43cd-b6b5-1d0f64974053 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:00.593778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ab6d-593c-43cd-b6b5-1d0f64974053 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:00.596805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 933/1888] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:25:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:25:00.616296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4ef64-1adb-4167-b79f-0c61f2c45170 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:00.616759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4ef64-1adb-4167-b79f-0c61f2c45170 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:00.617039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4ef64-1adb-4167-b79f-0c61f2c45170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:00.658771 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f2224-e1fd-4daf-ad8a-87120d94706f service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:00.661012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-11b4ef64-1adb-4167-b79f-0c61f2c45170 None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:00.662266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-11b4ef64-1adb-4167-b79f-0c61f2c45170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:00.676343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:00.677602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:00.680689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:00.683037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] PATH_INFO: `/v3/users/32cc1ae0a00945789330308da436888b` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:00.688071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32cc1ae0a00945789330308da436888b)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:00.697939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:00.804439 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32cc1ae0a00945789330308da436888b'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:00.817016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32cc1ae0a00945789330308da436888b'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:00.829500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32cc1ae0a00945789330308da436888b'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:00.830239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32cc1ae0a00945789330308da436888b'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:00.830938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-15a534db-5f1f-41d6-a5ce-7caafc4dc005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32cc1ae0a00945789330308da436888b'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:00.875626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 956/1889] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:00 2022] DELETE /identity/v3/users/32cc1ae0a00945789330308da436888b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:00.876294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 934/1890] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:25:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:00.877497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884755-752a-4fbb-8d23-650600a8fb1f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:00.877924 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884755-752a-4fbb-8d23-650600a8fb1f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:00.880014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884755-752a-4fbb-8d23-650600a8fb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:00.914137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-dd884755-752a-4fbb-8d23-650600a8fb1f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:00.915632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-dd884755-752a-4fbb-8d23-650600a8fb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:00.947776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4ef64-1adb-4167-b79f-0c61f2c45170 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:00.949474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-11b4ef64-1adb-4167-b79f-0c61f2c45170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:00.981475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4ef64-1adb-4167-b79f-0c61f2c45170 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:01.001928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 957/1891] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:01.039744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884755-752a-4fbb-8d23-650600a8fb1f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:01.042723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-dd884755-752a-4fbb-8d23-650600a8fb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:01.079010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6b4d-6be8-4fc2-8835-8ea1014b16b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:01.081717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6b4d-6be8-4fc2-8835-8ea1014b16b7 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:01.091569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6b4d-6be8-4fc2-8835-8ea1014b16b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:01.098607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6b4d-6be8-4fc2-8835-8ea1014b16b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:01.113207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d6b4d-6be8-4fc2-8835-8ea1014b16b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:01.115092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d6b4d-6be8-4fc2-8835-8ea1014b16b7 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:01.130769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 935/1892] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:01.171493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884755-752a-4fbb-8d23-650600a8fb1f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:01.179732 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a111e-b4bb-41e6-8996-4f340b096606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:01.180400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a111e-b4bb-41e6-8996-4f340b096606 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:01.180685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a111e-b4bb-41e6-8996-4f340b096606 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:01.180961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a111e-b4bb-41e6-8996-4f340b096606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:01.194477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a111e-b4bb-41e6-8996-4f340b096606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:01.196215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a111e-b4bb-41e6-8996-4f340b096606 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:01.208676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 958/1893] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:02.224399 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6b4d-6be8-4fc2-8835-8ea1014b16b7 service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:02.226609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-629d6b4d-6be8-4fc2-8835-8ea1014b16b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:02.264037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6b4d-6be8-4fc2-8835-8ea1014b16b7 service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:02.282373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:02.285269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:02.285637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:02.286873 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] PATH_INFO: `/v3/projects/641027cfc5444bcb8b0d29c0b4ddee8b` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:02.295886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] RBAC: Authorizing `identity:delete_project(project_id=641027cfc5444bcb8b0d29c0b4ddee8b)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:02.300659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:02.405193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641027cfc5444bcb8b0d29c0b4ddee8b', 'request_id': 'req-1b493008-09cc-4723-9162-3c73ed44838c'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.417612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641027cfc5444bcb8b0d29c0b4ddee8b', 'request_id': 'req-1b493008-09cc-4723-9162-3c73ed44838c'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.451817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641027cfc5444bcb8b0d29c0b4ddee8b', 'request_id': 'req-1b493008-09cc-4723-9162-3c73ed44838c'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.464192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] The token cache is being invalidate because project 641027cfc5444bcb8b0d29c0b4ddee8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:02.464489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.467071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.475542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a111e-b4bb-41e6-8996-4f340b096606 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:02.476901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 936/1894] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:02 2022] DELETE /identity/v3/projects/641027cfc5444bcb8b0d29c0b4ddee8b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:02.488303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a111e-b4bb-41e6-8996-4f340b096606 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:02.615494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:02.617934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:02.618552 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:02.618981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] PATH_INFO: `/v3/users/15920ebff9a7400ea41eb793a8c6fc86` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:02.620843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] RBAC: Authorizing `identity:delete_user(user_id=15920ebff9a7400ea41eb793a8c6fc86)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:02.625159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:02.730499 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15920ebff9a7400ea41eb793a8c6fc86'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.745027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15920ebff9a7400ea41eb793a8c6fc86'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.770487 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15920ebff9a7400ea41eb793a8c6fc86'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.774637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15920ebff9a7400ea41eb793a8c6fc86'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.775870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bab1c0d6-9bdb-4b37-9c0e-7f8190d7559d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15920ebff9a7400ea41eb793a8c6fc86'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:02.811483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 959/1895] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:02 2022] DELETE /identity/v3/users/15920ebff9a7400ea41eb793a8c6fc86 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:03.852181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:03.854465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:03.887624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b493008-09cc-4723-9162-3c73ed44838c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:03.978361 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:03.979271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:03.979563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:03.979839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] PATH_INFO: `/v3/projects/f4b80e9cfb2d45b2b4b6b2fdf145ebe1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:03.981051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b80e9cfb2d45b2b4b6b2fdf145ebe1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:03.983200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:04.034204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b80e9cfb2d45b2b4b6b2fdf145ebe1', 'request_id': 'req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:04.041752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b80e9cfb2d45b2b4b6b2fdf145ebe1', 'request_id': 'req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:04.050936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b80e9cfb2d45b2b4b6b2fdf145ebe1', 'request_id': 'req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:04.061914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] The token cache is being invalidate because project f4b80e9cfb2d45b2b4b6b2fdf145ebe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:04.062249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:04.062907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-95afb57e-ccf0-4e21-aeb8-5e4882a8c463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:04.064461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 937/1896] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:03 2022] DELETE /identity/v3/projects/f4b80e9cfb2d45b2b4b6b2fdf145ebe1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:04.070085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17814a1-71ce-466b-b06f-d5666c80db48 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.070632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17814a1-71ce-466b-b06f-d5666c80db48 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.070709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17814a1-71ce-466b-b06f-d5666c80db48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.104671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d17814a1-71ce-466b-b06f-d5666c80db48 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:04.107043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d17814a1-71ce-466b-b06f-d5666c80db48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:04.204767 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 960/1897] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:04.213013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530f113-6ba0-45b4-a8e8-d791133ede2c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.213527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530f113-6ba0-45b4-a8e8-d791133ede2c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.213856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530f113-6ba0-45b4-a8e8-d791133ede2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.246265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2530f113-6ba0-45b4-a8e8-d791133ede2c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:04.248529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2530f113-6ba0-45b4-a8e8-d791133ede2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:04.273559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 938/1898] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:04.277943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17814a1-71ce-466b-b06f-d5666c80db48 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:04.296973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17814a1-71ce-466b-b06f-d5666c80db48 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:04.315921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e6eb-5120-48cd-8af5-698fb6a15cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:04.316868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e6eb-5120-48cd-8af5-698fb6a15cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.317496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e6eb-5120-48cd-8af5-698fb6a15cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.317975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e6eb-5120-48cd-8af5-698fb6a15cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.319627 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e6eb-5120-48cd-8af5-698fb6a15cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:04.320138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e6eb-5120-48cd-8af5-698fb6a15cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:04.322372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e6eb-5120-48cd-8af5-698fb6a15cd0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:04.337785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 961/1899] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:25:04.342318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530f113-6ba0-45b4-a8e8-d791133ede2c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:04.357223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530f113-6ba0-45b4-a8e8-d791133ede2c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:04.367616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551875f-0b78-4e70-81b0-a677e13f2623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:04.368958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551875f-0b78-4e70-81b0-a677e13f2623 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.370655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551875f-0b78-4e70-81b0-a677e13f2623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.371108 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551875f-0b78-4e70-81b0-a677e13f2623 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.374634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551875f-0b78-4e70-81b0-a677e13f2623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:04.377022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551875f-0b78-4e70-81b0-a677e13f2623 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:04.406299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 939/1900] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:04 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:04.410635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e6eb-5120-48cd-8af5-698fb6a15cd0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:04.428148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e6eb-5120-48cd-8af5-698fb6a15cd0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:04.490824 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda18461-aa23-4b02-96ad-b17394a9bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:04.491510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda18461-aa23-4b02-96ad-b17394a9bf96 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.491793 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda18461-aa23-4b02-96ad-b17394a9bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.492076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda18461-aa23-4b02-96ad-b17394a9bf96 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.492777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda18461-aa23-4b02-96ad-b17394a9bf96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:04.494741 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda18461-aa23-4b02-96ad-b17394a9bf96 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:04.515242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 962/1901] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:04 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:04.519496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551875f-0b78-4e70-81b0-a677e13f2623 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:04.531855 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551875f-0b78-4e70-81b0-a677e13f2623 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:04.538138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0b1a-899e-4db7-8d94-c3d2c8219580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:04.538912 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0b1a-899e-4db7-8d94-c3d2c8219580 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.539192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0b1a-899e-4db7-8d94-c3d2c8219580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.539474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0b1a-899e-4db7-8d94-c3d2c8219580 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.540202 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b0b1a-899e-4db7-8d94-c3d2c8219580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:04.541831 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b0b1a-899e-4db7-8d94-c3d2c8219580 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:04.555921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 940/1902] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:04.557231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda18461-aa23-4b02-96ad-b17394a9bf96 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:04.568674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda18461-aa23-4b02-96ad-b17394a9bf96 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:04.576840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96894d1-aaef-4b1c-b456-e550d9d973bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:04.577424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96894d1-aaef-4b1c-b456-e550d9d973bc admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.577816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96894d1-aaef-4b1c-b456-e550d9d973bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.578101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96894d1-aaef-4b1c-b456-e550d9d973bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.578855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96894d1-aaef-4b1c-b456-e550d9d973bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:04.580580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96894d1-aaef-4b1c-b456-e550d9d973bc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:04.593133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 963/1903] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:04.597873 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0b1a-899e-4db7-8d94-c3d2c8219580 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:04.610304 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0b1a-899e-4db7-8d94-c3d2c8219580 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:04.633806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e4b68-2190-4f23-bc9a-7aaa186d811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:04.634789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e4b68-2190-4f23-bc9a-7aaa186d811e admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.635071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e4b68-2190-4f23-bc9a-7aaa186d811e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.635346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e4b68-2190-4f23-bc9a-7aaa186d811e admin admin] PATH_INFO: `/v3/projects/dc8de18800bb46d2a1f59a4d437dc968/users/b12e82c478d84f30b9e8eaec84531869/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.659415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e4b68-2190-4f23-bc9a-7aaa186d811e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8de18800bb46d2a1f59a4d437dc968, user_id=b12e82c478d84f30b9e8eaec84531869, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:04.662393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e4b68-2190-4f23-bc9a-7aaa186d811e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:04.684974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 941/1904] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:04 2022] PUT /identity/v3/projects/dc8de18800bb46d2a1f59a4d437dc968/users/b12e82c478d84f30b9e8eaec84531869/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:04.687548 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08136e1-74bd-4ad7-88dc-b958b856155c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.688050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08136e1-74bd-4ad7-88dc-b958b856155c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.688418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08136e1-74bd-4ad7-88dc-b958b856155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.729716 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c08136e1-74bd-4ad7-88dc-b958b856155c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:04.731890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c08136e1-74bd-4ad7-88dc-b958b856155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:04.842965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 964/1905] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:04.858459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e4b68-2190-4f23-bc9a-7aaa186d811e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:04.860877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3d3e4b68-2190-4f23-bc9a-7aaa186d811e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:04.864480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08136e1-74bd-4ad7-88dc-b958b856155c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:04.866321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c08136e1-74bd-4ad7-88dc-b958b856155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:04.881945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08136e1-74bd-4ad7-88dc-b958b856155c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:04.898697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:04.902803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.902803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.902803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] PATH_INFO: `/v3/users/a22121663c53439e97f4ce45ac2236bb` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.906142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22121663c53439e97f4ce45ac2236bb)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:04.910000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:04.971329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22121663c53439e97f4ce45ac2236bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:04.971721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e4b68-2190-4f23-bc9a-7aaa186d811e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:04.980619 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8ab6f-dba1-4513-87d7-eb618e6320b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:04.981434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8ab6f-dba1-4513-87d7-eb618e6320b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:04.981721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8ab6f-dba1-4513-87d7-eb618e6320b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:04.981996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8ab6f-dba1-4513-87d7-eb618e6320b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:04.985401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22121663c53439e97f4ce45ac2236bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:04.992028 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8ab6f-dba1-4513-87d7-eb618e6320b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:04.993579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8ab6f-dba1-4513-87d7-eb618e6320b5 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:04.994279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22121663c53439e97f4ce45ac2236bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:04.994894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22121663c53439e97f4ce45ac2236bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:04.995509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9c1e7a23-433e-43b6-a6c2-7291f6649ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22121663c53439e97f4ce45ac2236bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:05.003996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 942/1906] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:05.004950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8ab6f-dba1-4513-87d7-eb618e6320b5 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:05.007059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-61c8ab6f-dba1-4513-87d7-eb618e6320b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:05.020314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 965/1907] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:04 2022] DELETE /identity/v3/users/a22121663c53439e97f4ce45ac2236bb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:05.024940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a02a0f-c23c-4b7f-8705-62f397b170bf None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:05.025406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a02a0f-c23c-4b7f-8705-62f397b170bf None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:05.025861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a02a0f-c23c-4b7f-8705-62f397b170bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:05.051437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-75a02a0f-c23c-4b7f-8705-62f397b170bf None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:05.052846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-75a02a0f-c23c-4b7f-8705-62f397b170bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:05.080291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8ab6f-dba1-4513-87d7-eb618e6320b5 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:05.143059 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 966/1908] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:05.147958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:05.148735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:05.149124 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:05.149524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:05.151518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:05.158088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a02a0f-c23c-4b7f-8705-62f397b170bf None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:05.167923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-75a02a0f-c23c-4b7f-8705-62f397b170bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:05.244045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:05.245318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:05.263597 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a02a0f-c23c-4b7f-8705-62f397b170bf None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:05.271290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 943/1909] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:05.271669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c626eb-6743-4d5b-b8ca-d96d21ef97c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:05.272535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c626eb-6743-4d5b-b8ca-d96d21ef97c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:05.273014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c626eb-6743-4d5b-b8ca-d96d21ef97c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:05.273301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c626eb-6743-4d5b-b8ca-d96d21ef97c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:05.284622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c626eb-6743-4d5b-b8ca-d96d21ef97c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:05.286797 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c626eb-6743-4d5b-b8ca-d96d21ef97c1 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:05.309802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 967/1910] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:05.963263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:05.965480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:06.005102 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950fbd7-6f10-4dc0-9b9e-8b7869affc2d service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:06.017181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:06.018309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:06.020610 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:06.022763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] PATH_INFO: `/v3/projects/4fcf85ebcbed41dd9db7ab4f9db95b64` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:06.025697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fcf85ebcbed41dd9db7ab4f9db95b64)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:06.030885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:06.152686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fcf85ebcbed41dd9db7ab4f9db95b64', 'request_id': 'req-d27a52cd-31d2-483e-b234-a9869c520b8c'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.158269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38ae99-247f-4252-82c0-59eb862c42e6 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:06.159913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38ae99-247f-4252-82c0-59eb862c42e6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:06.160280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38ae99-247f-4252-82c0-59eb862c42e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:06.168722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fcf85ebcbed41dd9db7ab4f9db95b64', 'request_id': 'req-d27a52cd-31d2-483e-b234-a9869c520b8c'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.195509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fcf85ebcbed41dd9db7ab4f9db95b64', 'request_id': 'req-d27a52cd-31d2-483e-b234-a9869c520b8c'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.210317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-1f38ae99-247f-4252-82c0-59eb862c42e6 None None] MFA Rules not processed for user `b12e82c478d84f30b9e8eaec84531869`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:06.211815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1f38ae99-247f-4252-82c0-59eb862c42e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:06.214000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] The token cache is being invalidate because project 4fcf85ebcbed41dd9db7ab4f9db95b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:06.214974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.216997 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.232041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 944/1911] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:05 2022] DELETE /identity/v3/projects/4fcf85ebcbed41dd9db7ab4f9db95b64 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:06.232041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:06.239999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:06.348376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 968/1912] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:06.360329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38ae99-247f-4252-82c0-59eb862c42e6 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:06.362022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1f38ae99-247f-4252-82c0-59eb862c42e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:06.385269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a52cd-31d2-483e-b234-a9869c520b8c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:06.396738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:06.397978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:06.398963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:06.398963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] PATH_INFO: `/v3/users/d324010403bf4f738a6f70ff099f127b` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:06.403541 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d324010403bf4f738a6f70ff099f127b)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:06.407501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:06.477970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38ae99-247f-4252-82c0-59eb862c42e6 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:06.490511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbad33d-5be3-4c4c-aeb0-fa9d2ca985f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:06.491497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbad33d-5be3-4c4c-aeb0-fa9d2ca985f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:06.491927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbad33d-5be3-4c4c-aeb0-fa9d2ca985f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:06.492364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbad33d-5be3-4c4c-aeb0-fa9d2ca985f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:06.503717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbad33d-5be3-4c4c-aeb0-fa9d2ca985f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:06.505629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbad33d-5be3-4c4c-aeb0-fa9d2ca985f4 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:06.512891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd324010403bf4f738a6f70ff099f127b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.519210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 969/1913] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:06.525042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd324010403bf4f738a6f70ff099f127b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.526022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd324010403bf4f738a6f70ff099f127b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.545596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd324010403bf4f738a6f70ff099f127b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.561239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-abde287e-ce77-4462-a8af-e097432e6053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd324010403bf4f738a6f70ff099f127b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:06.569540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 945/1914] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:06 2022] DELETE /identity/v3/users/d324010403bf4f738a6f70ff099f127b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:07.075063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbad33d-5be3-4c4c-aeb0-fa9d2ca985f4 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:07.093563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbad33d-5be3-4c4c-aeb0-fa9d2ca985f4 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:07.230157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:07.231066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.231352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.231626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] PATH_INFO: `/v3/projects/448e617f81ad4c99abf1a711fbc8f2ff` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.234498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=448e617f81ad4c99abf1a711fbc8f2ff)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:07.236401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:07.323285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448e617f81ad4c99abf1a711fbc8f2ff', 'request_id': 'req-583a4e84-23aa-4402-b4d3-7956934fc11d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:07.333093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448e617f81ad4c99abf1a711fbc8f2ff', 'request_id': 'req-583a4e84-23aa-4402-b4d3-7956934fc11d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:07.351216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448e617f81ad4c99abf1a711fbc8f2ff', 'request_id': 'req-583a4e84-23aa-4402-b4d3-7956934fc11d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:07.377163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] The token cache is being invalidate because project 448e617f81ad4c99abf1a711fbc8f2ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:07.377461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:07.379722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-583a4e84-23aa-4402-b4d3-7956934fc11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:07.382518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 970/1915] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:07 2022] DELETE /identity/v3/projects/448e617f81ad4c99abf1a711fbc8f2ff => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:07.387808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec97a-60eb-487d-9773-66c9eb2a0aae None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.391222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec97a-60eb-487d-9773-66c9eb2a0aae None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.391773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec97a-60eb-487d-9773-66c9eb2a0aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.416399 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-14aec97a-60eb-487d-9773-66c9eb2a0aae None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:07.417593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-14aec97a-60eb-487d-9773-66c9eb2a0aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:07.481608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 946/1916] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:07.489788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3a18a-577f-42f2-aa27-6946da8bcc8b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.490077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3a18a-577f-42f2-aa27-6946da8bcc8b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.490583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3a18a-577f-42f2-aa27-6946da8bcc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.510853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-5ce3a18a-577f-42f2-aa27-6946da8bcc8b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:07.512076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-5ce3a18a-577f-42f2-aa27-6946da8bcc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:07.523083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 971/1917] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:07.527308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec97a-60eb-487d-9773-66c9eb2a0aae None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:07.537977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec97a-60eb-487d-9773-66c9eb2a0aae None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:07.542894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd4105-5764-4085-8a5b-75a8423fe878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:07.543639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd4105-5764-4085-8a5b-75a8423fe878 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.543992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd4105-5764-4085-8a5b-75a8423fe878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.544344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd4105-5764-4085-8a5b-75a8423fe878 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.545140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd4105-5764-4085-8a5b-75a8423fe878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:07.545805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd4105-5764-4085-8a5b-75a8423fe878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:07.547187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd4105-5764-4085-8a5b-75a8423fe878 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:07.562758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 947/1918] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:25:07.564170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3a18a-577f-42f2-aa27-6946da8bcc8b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:07.573734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3a18a-577f-42f2-aa27-6946da8bcc8b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:07.578678 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15291e9-fb77-42eb-bd7c-0767c5fec463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:07.579336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15291e9-fb77-42eb-bd7c-0767c5fec463 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.579618 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15291e9-fb77-42eb-bd7c-0767c5fec463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.579892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15291e9-fb77-42eb-bd7c-0767c5fec463 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.580916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15291e9-fb77-42eb-bd7c-0767c5fec463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:07.583015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15291e9-fb77-42eb-bd7c-0767c5fec463 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:07.613001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 972/1919] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:07 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:07.614559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd4105-5764-4085-8a5b-75a8423fe878 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:07.624714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd4105-5764-4085-8a5b-75a8423fe878 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:07.684292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df11bd-64e7-46c8-a185-27c83808033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:07.685001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df11bd-64e7-46c8-a185-27c83808033f admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.685286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df11bd-64e7-46c8-a185-27c83808033f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.685559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df11bd-64e7-46c8-a185-27c83808033f admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.686334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df11bd-64e7-46c8-a185-27c83808033f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:07.688254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df11bd-64e7-46c8-a185-27c83808033f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:07.707762 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 948/1920] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:07 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:07.712539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15291e9-fb77-42eb-bd7c-0767c5fec463 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:07.722747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15291e9-fb77-42eb-bd7c-0767c5fec463 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:07.728328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b95a-7c1c-47f1-add0-31e5f77f84da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:07.729000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b95a-7c1c-47f1-add0-31e5f77f84da admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.729322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b95a-7c1c-47f1-add0-31e5f77f84da admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.729604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b95a-7c1c-47f1-add0-31e5f77f84da admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.730365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b95a-7c1c-47f1-add0-31e5f77f84da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:07.731958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b95a-7c1c-47f1-add0-31e5f77f84da admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:07.742342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 973/1921] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:07.746337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df11bd-64e7-46c8-a185-27c83808033f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:07.761525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df11bd-64e7-46c8-a185-27c83808033f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:07.766508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83e4d7-e599-4880-b09e-0a5bedf54d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:07.767189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e4d7-e599-4880-b09e-0a5bedf54d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.767476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e4d7-e599-4880-b09e-0a5bedf54d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.767760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e4d7-e599-4880-b09e-0a5bedf54d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.768538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83e4d7-e599-4880-b09e-0a5bedf54d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:07.770088 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83e4d7-e599-4880-b09e-0a5bedf54d3c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:07.781092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 949/1922] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:07.786379 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b95a-7c1c-47f1-add0-31e5f77f84da admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:07.796334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b95a-7c1c-47f1-add0-31e5f77f84da admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:07.801026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1700397-b758-4361-bc9c-34e2a28075cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:07.802118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1700397-b758-4361-bc9c-34e2a28075cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.802427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1700397-b758-4361-bc9c-34e2a28075cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.802702 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1700397-b758-4361-bc9c-34e2a28075cd admin admin] PATH_INFO: `/v3/projects/898c667bb749499591885f0fda8f9c7a/users/826719bf391f4aa59ef53561e92488af/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.817109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1700397-b758-4361-bc9c-34e2a28075cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=898c667bb749499591885f0fda8f9c7a, user_id=826719bf391f4aa59ef53561e92488af, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:07.820392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1700397-b758-4361-bc9c-34e2a28075cd admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:07.833206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 974/1923] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:07 2022] PUT /identity/v3/projects/898c667bb749499591885f0fda8f9c7a/users/826719bf391f4aa59ef53561e92488af/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:07.844182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c0980-2176-46a3-a8b2-72d295ad2409 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:07.844498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c0980-2176-46a3-a8b2-72d295ad2409 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:07.844793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c0980-2176-46a3-a8b2-72d295ad2409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:07.872183 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1d4c0980-2176-46a3-a8b2-72d295ad2409 None None] MFA Rules not processed for user `826719bf391f4aa59ef53561e92488af`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:07.873488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1d4c0980-2176-46a3-a8b2-72d295ad2409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:07.938349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 950/1924] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:07.942796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1700397-b758-4361-bc9c-34e2a28075cd admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:08.003483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1700397-b758-4361-bc9c-34e2a28075cd admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:08.008827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35106005-85fd-4727-9fa8-670bee893c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:08.009491 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35106005-85fd-4727-9fa8-670bee893c7d admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.009778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35106005-85fd-4727-9fa8-670bee893c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.010053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35106005-85fd-4727-9fa8-670bee893c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.010779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35106005-85fd-4727-9fa8-670bee893c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:08.012716 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35106005-85fd-4727-9fa8-670bee893c7d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:08.037810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 975/1925] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:07 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:08.042038 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c0980-2176-46a3-a8b2-72d295ad2409 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:08.052720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c0980-2176-46a3-a8b2-72d295ad2409 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:08.106668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a757bf-ee79-4fba-ac10-f5b16e1322dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:08.107341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a757bf-ee79-4fba-ac10-f5b16e1322dc admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.107628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a757bf-ee79-4fba-ac10-f5b16e1322dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.107906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a757bf-ee79-4fba-ac10-f5b16e1322dc admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.108607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a757bf-ee79-4fba-ac10-f5b16e1322dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:08.110557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a757bf-ee79-4fba-ac10-f5b16e1322dc admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:08.134805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 951/1926] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:08 2022] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:08.136096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35106005-85fd-4727-9fa8-670bee893c7d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:08.146364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35106005-85fd-4727-9fa8-670bee893c7d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:08.151141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264a6eb-1ffb-40db-9f86-26888be874bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:08.151830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264a6eb-1ffb-40db-9f86-26888be874bc admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.152148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264a6eb-1ffb-40db-9f86-26888be874bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.152449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264a6eb-1ffb-40db-9f86-26888be874bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.153201 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264a6eb-1ffb-40db-9f86-26888be874bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:08.154832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264a6eb-1ffb-40db-9f86-26888be874bc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:08.165609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 976/1927] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:08.169694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a757bf-ee79-4fba-ac10-f5b16e1322dc admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:08.181078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a757bf-ee79-4fba-ac10-f5b16e1322dc admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:08.186212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326265a-b85c-421c-85be-d6d39c8b9553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:08.187281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326265a-b85c-421c-85be-d6d39c8b9553 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.187716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326265a-b85c-421c-85be-d6d39c8b9553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.188174 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326265a-b85c-421c-85be-d6d39c8b9553 admin admin] PATH_INFO: `/v3/projects/9cadaee05e9a46d3b555ce054ae77a09/users/b0699fd403424b10988caec1c3840300/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.203978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326265a-b85c-421c-85be-d6d39c8b9553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cadaee05e9a46d3b555ce054ae77a09, user_id=b0699fd403424b10988caec1c3840300, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:08.206701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326265a-b85c-421c-85be-d6d39c8b9553 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:08.219943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 952/1928] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:08 2022] PUT /identity/v3/projects/9cadaee05e9a46d3b555ce054ae77a09/users/b0699fd403424b10988caec1c3840300/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:08.223717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264a6eb-1ffb-40db-9f86-26888be874bc admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:08.234203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264a6eb-1ffb-40db-9f86-26888be874bc admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:08.319266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61c4ba-3c31-4e93-9713-62d8c0811a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:08.319991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61c4ba-3c31-4e93-9713-62d8c0811a0d admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.320454 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61c4ba-3c31-4e93-9713-62d8c0811a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.320883 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61c4ba-3c31-4e93-9713-62d8c0811a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.321743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61c4ba-3c31-4e93-9713-62d8c0811a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:08.323420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61c4ba-3c31-4e93-9713-62d8c0811a0d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:08.343646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 977/1929] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:08.343748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326265a-b85c-421c-85be-d6d39c8b9553 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:08.362015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326265a-b85c-421c-85be-d6d39c8b9553 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:08.370020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2271ca-93a7-4dd1-8d3f-3a87d57cb24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:08.371184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2271ca-93a7-4dd1-8d3f-3a87d57cb24f admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.371476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2271ca-93a7-4dd1-8d3f-3a87d57cb24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.371939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2271ca-93a7-4dd1-8d3f-3a87d57cb24f admin admin] PATH_INFO: `/v3/projects/9cadaee05e9a46d3b555ce054ae77a09/users/b0699fd403424b10988caec1c3840300/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.375998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2271ca-93a7-4dd1-8d3f-3a87d57cb24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cadaee05e9a46d3b555ce054ae77a09, user_id=b0699fd403424b10988caec1c3840300, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:08.378935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2271ca-93a7-4dd1-8d3f-3a87d57cb24f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:08.390782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 953/1930] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:08 2022] PUT /identity/v3/projects/9cadaee05e9a46d3b555ce054ae77a09/users/b0699fd403424b10988caec1c3840300/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:08.401637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f694e4-2a28-46c0-9214-e9d2d9f49c17 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.401962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f694e4-2a28-46c0-9214-e9d2d9f49c17 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.402294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f694e4-2a28-46c0-9214-e9d2d9f49c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.433165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-08f694e4-2a28-46c0-9214-e9d2d9f49c17 None None] MFA Rules not processed for user `b0699fd403424b10988caec1c3840300`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:08.440991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-08f694e4-2a28-46c0-9214-e9d2d9f49c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:08.566525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 978/1931] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:08.586020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2271ca-93a7-4dd1-8d3f-3a87d57cb24f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:08.588575 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1f2271ca-93a7-4dd1-8d3f-3a87d57cb24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:08.655590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2271ca-93a7-4dd1-8d3f-3a87d57cb24f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:08.660569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b9606-a6bb-4558-98dc-9a8a3fe52af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:08.661371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b9606-a6bb-4558-98dc-9a8a3fe52af2 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.661902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b9606-a6bb-4558-98dc-9a8a3fe52af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.661902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b9606-a6bb-4558-98dc-9a8a3fe52af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.684523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b9606-a6bb-4558-98dc-9a8a3fe52af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:08.686652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b9606-a6bb-4558-98dc-9a8a3fe52af2 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:08.698831 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 954/1932] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:08.817386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f694e4-2a28-46c0-9214-e9d2d9f49c17 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:08.818930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-08f694e4-2a28-46c0-9214-e9d2d9f49c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:08.851594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b9606-a6bb-4558-98dc-9a8a3fe52af2 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:08.892956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f694e4-2a28-46c0-9214-e9d2d9f49c17 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:08.897527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:08.898455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.898742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.899019 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] PATH_INFO: `/v3/users/080cc44adbcd4a4eb6062fa6005506ed` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.900199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=080cc44adbcd4a4eb6062fa6005506ed)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:08.902134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:08.916663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b9606-a6bb-4558-98dc-9a8a3fe52af2 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:08.921210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:08.922112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.922429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.922704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] PATH_INFO: `/v3/users/826719bf391f4aa59ef53561e92488af` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.923896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=826719bf391f4aa59ef53561e92488af)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:08.925995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:08.949257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080cc44adbcd4a4eb6062fa6005506ed'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:08.956812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080cc44adbcd4a4eb6062fa6005506ed'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:08.965241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080cc44adbcd4a4eb6062fa6005506ed'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:08.965911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080cc44adbcd4a4eb6062fa6005506ed'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:08.966550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-551ff3bc-c581-4776-9296-f55f82c6fd1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080cc44adbcd4a4eb6062fa6005506ed'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:08.977871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826719bf391f4aa59ef53561e92488af'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:08.984382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 979/1933] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:08 2022] DELETE /identity/v3/users/080cc44adbcd4a4eb6062fa6005506ed => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:08.986395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826719bf391f4aa59ef53561e92488af'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:08.987096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826719bf391f4aa59ef53561e92488af'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:08.988781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7152b63-4852-4f55-aa0d-b0165df25efd None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:08.989074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7152b63-4852-4f55-aa0d-b0165df25efd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:08.989357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7152b63-4852-4f55-aa0d-b0165df25efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:08.995407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826719bf391f4aa59ef53561e92488af'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.009360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-b7152b63-4852-4f55-aa0d-b0165df25efd None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:09.010612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b7152b63-4852-4f55-aa0d-b0165df25efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:09.011796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9f61cd35-ae3b-4fde-8ec0-914f9ccbefd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826719bf391f4aa59ef53561e92488af'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.018064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 955/1934] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:08 2022] DELETE /identity/v3/users/826719bf391f4aa59ef53561e92488af => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:09.022445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdcd60-5439-4b90-8385-706b428c231d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:09.022737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdcd60-5439-4b90-8385-706b428c231d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:09.023012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdcd60-5439-4b90-8385-706b428c231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:09.040034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-6efdcd60-5439-4b90-8385-706b428c231d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:09.041149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6efdcd60-5439-4b90-8385-706b428c231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:09.069230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 980/1935] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:09.079446 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7152b63-4852-4f55-aa0d-b0165df25efd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:09.080987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b7152b63-4852-4f55-aa0d-b0165df25efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:09.100620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 956/1936] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:09.110188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdcd60-5439-4b90-8385-706b428c231d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:09.111501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6efdcd60-5439-4b90-8385-706b428c231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:09.136880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7152b63-4852-4f55-aa0d-b0165df25efd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:09.164961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdcd60-5439-4b90-8385-706b428c231d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:09.169894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb894b-1665-4631-8ead-4bd8e5afcc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:09.170455 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb894b-1665-4631-8ead-4bd8e5afcc94 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:09.170741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb894b-1665-4631-8ead-4bd8e5afcc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:09.171017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb894b-1665-4631-8ead-4bd8e5afcc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:09.181094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb894b-1665-4631-8ead-4bd8e5afcc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:09.182577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb894b-1665-4631-8ead-4bd8e5afcc94 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:09.185320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a78cc7-14b7-4a88-9d86-bc9bd0941a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:09.185981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a78cc7-14b7-4a88-9d86-bc9bd0941a14 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:09.186314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a78cc7-14b7-4a88-9d86-bc9bd0941a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:09.186595 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a78cc7-14b7-4a88-9d86-bc9bd0941a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:09.192834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 957/1937] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:09.196588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a78cc7-14b7-4a88-9d86-bc9bd0941a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:09.198011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a78cc7-14b7-4a88-9d86-bc9bd0941a14 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:09.207776 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 981/1938] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:09.232588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6b55-d5b7-45ea-bc22-45acfef0104a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:09.233010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6b55-d5b7-45ea-bc22-45acfef0104a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:09.233235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6b55-d5b7-45ea-bc22-45acfef0104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:09.250405 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-798d6b55-d5b7-45ea-bc22-45acfef0104a None None] MFA Rules not processed for user `b12e82c478d84f30b9e8eaec84531869`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:09.251602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-798d6b55-d5b7-45ea-bc22-45acfef0104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:09.341736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 958/1939] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:09.648195 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a78cc7-14b7-4a88-9d86-bc9bd0941a14 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:09.649764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-39a78cc7-14b7-4a88-9d86-bc9bd0941a14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:09.665042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a78cc7-14b7-4a88-9d86-bc9bd0941a14 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:09.671317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:09.672552 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:09.673038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:09.673520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] PATH_INFO: `/v3/projects/02c02438a1bf4945860816fa7b853e76` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:09.675401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c02438a1bf4945860816fa7b853e76)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:09.679470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:09.732865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c02438a1bf4945860816fa7b853e76', 'request_id': 'req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.741886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c02438a1bf4945860816fa7b853e76', 'request_id': 'req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.748767 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c02438a1bf4945860816fa7b853e76', 'request_id': 'req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.759707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] The token cache is being invalidate because project 02c02438a1bf4945860816fa7b853e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:09.760114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.760726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.762535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 982/1940] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:09 2022] DELETE /identity/v3/projects/02c02438a1bf4945860816fa7b853e76 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:09.766189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6b55-d5b7-45ea-bc22-45acfef0104a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:09.779027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6b55-d5b7-45ea-bc22-45acfef0104a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:09.842120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:09.843568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:09.848161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:09.849254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:09.850852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:09.851266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] PATH_INFO: `/v3/users/d9d456c07a704d13abbb4522f2b0e12e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:09.853647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d456c07a704d13abbb4522f2b0e12e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:09.857333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:09.859963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2617ed8-d177-4f7d-a332-cfaf50f7bfe6 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:09.866395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:09.867352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:09.867638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:09.867910 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] PATH_INFO: `/v3/projects/898c667bb749499591885f0fda8f9c7a` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:09.869169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898c667bb749499591885f0fda8f9c7a)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:09.871657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:09.932972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d456c07a704d13abbb4522f2b0e12e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.942986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d456c07a704d13abbb4522f2b0e12e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.944502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d456c07a704d13abbb4522f2b0e12e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.951886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d456c07a704d13abbb4522f2b0e12e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.959478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898c667bb749499591885f0fda8f9c7a', 'request_id': 'req-d5ac10fc-1c93-4643-ae43-c4a223202ac1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.970057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d456c07a704d13abbb4522f2b0e12e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.971389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898c667bb749499591885f0fda8f9c7a', 'request_id': 'req-d5ac10fc-1c93-4643-ae43-c4a223202ac1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.979174 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 959/1941] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:09 2022] DELETE /identity/v3/users/d9d456c07a704d13abbb4522f2b0e12e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:09.981942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898c667bb749499591885f0fda8f9c7a', 'request_id': 'req-d5ac10fc-1c93-4643-ae43-c4a223202ac1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.992921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] The token cache is being invalidate because project 898c667bb749499591885f0fda8f9c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:09.993270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.993986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:09.996222 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 983/1942] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:09 2022] DELETE /identity/v3/projects/898c667bb749499591885f0fda8f9c7a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:10.000035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:10.001774 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:10.076083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8630ed-8937-4d24-9deb-c1814937fe3d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:10.081222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:10.082163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:10.082442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:10.082735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] PATH_INFO: `/v3/users/b0699fd403424b10988caec1c3840300` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:10.084535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0699fd403424b10988caec1c3840300)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:10.086621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:10.138834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0699fd403424b10988caec1c3840300'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.150518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0699fd403424b10988caec1c3840300'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.151498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0699fd403424b10988caec1c3840300'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.160261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0699fd403424b10988caec1c3840300'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.174854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0699fd403424b10988caec1c3840300'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.185189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 960/1943] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:09 2022] DELETE /identity/v3/users/b0699fd403424b10988caec1c3840300 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:10.359123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:10.360573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:10.500496 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac10fc-1c93-4643-ae43-c4a223202ac1 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:10.603210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:10.604167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:10.604461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:10.604745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] PATH_INFO: `/v3/projects/db59566083a14b4fb91b721fee99b7d5` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:10.606523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=db59566083a14b4fb91b721fee99b7d5)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:10.608858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:10.679185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db59566083a14b4fb91b721fee99b7d5', 'request_id': 'req-275c13b3-ec53-4ab9-b4d2-6671daad48fc'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.688821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db59566083a14b4fb91b721fee99b7d5', 'request_id': 'req-275c13b3-ec53-4ab9-b4d2-6671daad48fc'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.698120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db59566083a14b4fb91b721fee99b7d5', 'request_id': 'req-275c13b3-ec53-4ab9-b4d2-6671daad48fc'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.714921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] The token cache is being invalidate because project db59566083a14b4fb91b721fee99b7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:10.716603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.717562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:10.720454 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 984/1944] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:10 2022] DELETE /identity/v3/projects/db59566083a14b4fb91b721fee99b7d5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:10.725237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:10.726919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:10.753039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:10.753422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142f72-2bbb-4c4a-bde5-87f773a4a8a5 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:10.754651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:10.846935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:10.848002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:10.848284 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:10.850218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] PATH_INFO: `/v3/users/e09e11c4740d4581983febed3a82fb26` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:10.854494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09e11c4740d4581983febed3a82fb26)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:10.861665 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:10.893648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c13b3-ec53-4ab9-b4d2-6671daad48fc admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:10.911820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:10.918145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:10.918447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:10.921830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] PATH_INFO: `/v3/projects/9cadaee05e9a46d3b555ce054ae77a09` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:10.923491 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cadaee05e9a46d3b555ce054ae77a09)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:10.928559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:11.017231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09e11c4740d4581983febed3a82fb26'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.046812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09e11c4740d4581983febed3a82fb26'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.047265 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cadaee05e9a46d3b555ce054ae77a09', 'request_id': 'req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.048102 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09e11c4740d4581983febed3a82fb26'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.059960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09e11c4740d4581983febed3a82fb26'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.063429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cadaee05e9a46d3b555ce054ae77a09', 'request_id': 'req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.078722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cadaee05e9a46d3b555ce054ae77a09', 'request_id': 'req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.085028 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4ed9fc96-bfb9-44a3-8e3b-013c1eb200eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09e11c4740d4581983febed3a82fb26'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.096138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 961/1945] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:10 2022] DELETE /identity/v3/users/e09e11c4740d4581983febed3a82fb26 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:11.102867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] The token cache is being invalidate because project 9cadaee05e9a46d3b555ce054ae77a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:11.104606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.106066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-3f0cffdb-4d8d-4513-94f4-e3d41321e00a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:11.113842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 985/1946] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:10 2022] DELETE /identity/v3/projects/9cadaee05e9a46d3b555ce054ae77a09 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:11.116627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe345445-6b63-4a52-966c-cdded331737d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:11.117115 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe345445-6b63-4a52-966c-cdded331737d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:11.117297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe345445-6b63-4a52-966c-cdded331737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:11.157426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-fe345445-6b63-4a52-966c-cdded331737d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:11.164178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fe345445-6b63-4a52-966c-cdded331737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:11.314261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 962/1947] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:11.314736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1d8c0-a84c-4952-b331-bfe307a08059 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:11.315473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1d8c0-a84c-4952-b331-bfe307a08059 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:11.315830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1d8c0-a84c-4952-b331-bfe307a08059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:11.343621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-6cc1d8c0-a84c-4952-b331-bfe307a08059 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:11.345410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6cc1d8c0-a84c-4952-b331-bfe307a08059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:11.364974 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 986/1948] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:11.369409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe345445-6b63-4a52-966c-cdded331737d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:11.382633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe345445-6b63-4a52-966c-cdded331737d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:11.392977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ed2dd-5ce3-413c-a9bc-31c2f5da397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:11.393664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ed2dd-5ce3-413c-a9bc-31c2f5da397c admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:11.393951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ed2dd-5ce3-413c-a9bc-31c2f5da397c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:11.394289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ed2dd-5ce3-413c-a9bc-31c2f5da397c admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:11.395161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ed2dd-5ce3-413c-a9bc-31c2f5da397c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:11.395515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ed2dd-5ce3-413c-a9bc-31c2f5da397c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:11.397206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ed2dd-5ce3-413c-a9bc-31c2f5da397c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:11.437176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 963/1949] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:25:11.440516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1d8c0-a84c-4952-b331-bfe307a08059 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:11.450884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1d8c0-a84c-4952-b331-bfe307a08059 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:11.457524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6aa14-8dbe-4d11-b8ea-2bedd78c67c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:11.458086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6aa14-8dbe-4d11-b8ea-2bedd78c67c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:11.458748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6aa14-8dbe-4d11-b8ea-2bedd78c67c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:11.459063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6aa14-8dbe-4d11-b8ea-2bedd78c67c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:11.459760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6aa14-8dbe-4d11-b8ea-2bedd78c67c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:11.461794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6aa14-8dbe-4d11-b8ea-2bedd78c67c0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:11.490935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 987/1950] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:11 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:11.495105 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ed2dd-5ce3-413c-a9bc-31c2f5da397c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:11.506991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ed2dd-5ce3-413c-a9bc-31c2f5da397c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:11.578410 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b8973-6295-44bf-8d0c-6ca5f2c519d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:11.579208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b8973-6295-44bf-8d0c-6ca5f2c519d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:11.580376 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b8973-6295-44bf-8d0c-6ca5f2c519d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:11.580759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b8973-6295-44bf-8d0c-6ca5f2c519d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:11.582214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b8973-6295-44bf-8d0c-6ca5f2c519d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:11.584432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b8973-6295-44bf-8d0c-6ca5f2c519d8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:11.608217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 964/1951] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:11 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:11.613355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6aa14-8dbe-4d11-b8ea-2bedd78c67c0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:11.632331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6aa14-8dbe-4d11-b8ea-2bedd78c67c0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:11.638083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799796d5-02fd-4f46-8c9b-1627b2ca1cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:11.638801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799796d5-02fd-4f46-8c9b-1627b2ca1cad admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:11.639088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799796d5-02fd-4f46-8c9b-1627b2ca1cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:11.639367 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799796d5-02fd-4f46-8c9b-1627b2ca1cad admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:11.640095 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799796d5-02fd-4f46-8c9b-1627b2ca1cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:11.641905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799796d5-02fd-4f46-8c9b-1627b2ca1cad admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:11.655256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 988/1952] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:11.660675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b8973-6295-44bf-8d0c-6ca5f2c519d8 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:11.672260 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b8973-6295-44bf-8d0c-6ca5f2c519d8 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:11.679890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6453a4-decb-4515-927a-4fa9a5835cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:11.680653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6453a4-decb-4515-927a-4fa9a5835cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:11.681012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6453a4-decb-4515-927a-4fa9a5835cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:11.681492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6453a4-decb-4515-927a-4fa9a5835cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:11.682336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6453a4-decb-4515-927a-4fa9a5835cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:11.685843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6453a4-decb-4515-927a-4fa9a5835cc2 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:11.699914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 965/1953] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:11.701991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799796d5-02fd-4f46-8c9b-1627b2ca1cad admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:11.716547 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799796d5-02fd-4f46-8c9b-1627b2ca1cad admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:11.722051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defd849-9b38-4421-925b-99f55e5c3ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:11.723259 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defd849-9b38-4421-925b-99f55e5c3ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:11.723624 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defd849-9b38-4421-925b-99f55e5c3ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:11.724041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defd849-9b38-4421-925b-99f55e5c3ef4 admin admin] PATH_INFO: `/v3/projects/e53d9fbfc82246fb9dd63ed27638222d/users/24e6f38654d7463c81a4a36f3a101ff9/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:11.741312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defd849-9b38-4421-925b-99f55e5c3ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e53d9fbfc82246fb9dd63ed27638222d, user_id=24e6f38654d7463c81a4a36f3a101ff9, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:11.744831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defd849-9b38-4421-925b-99f55e5c3ef4 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:11.761065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 989/1954] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:11 2022] PUT /identity/v3/projects/e53d9fbfc82246fb9dd63ed27638222d/users/24e6f38654d7463c81a4a36f3a101ff9/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:11.772820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26794a2-2b3d-4609-94f4-83cd0435f4d7 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:11.773203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26794a2-2b3d-4609-94f4-83cd0435f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:11.773641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26794a2-2b3d-4609-94f4-83cd0435f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:11.814626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a26794a2-2b3d-4609-94f4-83cd0435f4d7 None None] MFA Rules not processed for user `24e6f38654d7463c81a4a36f3a101ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:11.814626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a26794a2-2b3d-4609-94f4-83cd0435f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:11.913102 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 966/1955] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:11.917532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defd849-9b38-4421-925b-99f55e5c3ef4 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:11.920051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26794a2-2b3d-4609-94f4-83cd0435f4d7 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:11.923528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a26794a2-2b3d-4609-94f4-83cd0435f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:12.029649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26794a2-2b3d-4609-94f4-83cd0435f4d7 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.035045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.036173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.036613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.037066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] PATH_INFO: `/v3/projects/1f32d85526ca4b4297f2f2b5ea420a6b` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.038580 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f32d85526ca4b4297f2f2b5ea420a6b)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.039929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defd849-9b38-4421-925b-99f55e5c3ef4 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.040879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.047656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6bf2f-086b-44bc-92e7-06dd85683009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.048812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bf2f-086b-44bc-92e7-06dd85683009 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.049230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bf2f-086b-44bc-92e7-06dd85683009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.049611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bf2f-086b-44bc-92e7-06dd85683009 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.050605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6bf2f-086b-44bc-92e7-06dd85683009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.054303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6bf2f-086b-44bc-92e7-06dd85683009 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.086303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 990/1956] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:11 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:12.089952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6bf2f-086b-44bc-92e7-06dd85683009 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.099830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f32d85526ca4b4297f2f2b5ea420a6b', 'request_id': 'req-02231ace-487b-4c75-a470-17094e3a519d'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:12.106684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f32d85526ca4b4297f2f2b5ea420a6b', 'request_id': 'req-02231ace-487b-4c75-a470-17094e3a519d'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:12.117760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f32d85526ca4b4297f2f2b5ea420a6b', 'request_id': 'req-02231ace-487b-4c75-a470-17094e3a519d'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:12.132092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] The token cache is being invalidate because project 1f32d85526ca4b4297f2f2b5ea420a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:12.133408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:12.134019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-02231ace-487b-4c75-a470-17094e3a519d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:12.135952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 967/1957] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:11 2022] DELETE /identity/v3/projects/1f32d85526ca4b4297f2f2b5ea420a6b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:12.141635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2711ed-1557-4c57-a22b-b9e1a95b646e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.141931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2711ed-1557-4c57-a22b-b9e1a95b646e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.142240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2711ed-1557-4c57-a22b-b9e1a95b646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.161850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-8a2711ed-1557-4c57-a22b-b9e1a95b646e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:12.163064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8a2711ed-1557-4c57-a22b-b9e1a95b646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:12.163560 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6bf2f-086b-44bc-92e7-06dd85683009 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.168378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840a8e-6381-440d-a1f4-0119cc79beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.169630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840a8e-6381-440d-a1f4-0119cc79beb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.170011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840a8e-6381-440d-a1f4-0119cc79beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.170327 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840a8e-6381-440d-a1f4-0119cc79beb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.171027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76840a8e-6381-440d-a1f4-0119cc79beb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.172261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 968/1958] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:12.172939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76840a8e-6381-440d-a1f4-0119cc79beb5 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.180970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b96ce2-32f0-4974-82f7-213627486da6 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.181386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b96ce2-32f0-4974-82f7-213627486da6 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.181772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b96ce2-32f0-4974-82f7-213627486da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.197556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 991/1959] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:12 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:12.201333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840a8e-6381-440d-a1f4-0119cc79beb5 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.201460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-43b96ce2-32f0-4974-82f7-213627486da6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:12.202735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-43b96ce2-32f0-4974-82f7-213627486da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:12.203078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-76840a8e-6381-440d-a1f4-0119cc79beb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:12.211064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 969/1960] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:12.215047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b96ce2-32f0-4974-82f7-213627486da6 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.218754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840a8e-6381-440d-a1f4-0119cc79beb5 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.222964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002b597-767e-4199-94b3-6b9c077be58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.223946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002b597-767e-4199-94b3-6b9c077be58d admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.224371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002b597-767e-4199-94b3-6b9c077be58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.225305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b96ce2-32f0-4974-82f7-213627486da6 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.225426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002b597-767e-4199-94b3-6b9c077be58d admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.226526 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002b597-767e-4199-94b3-6b9c077be58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.229042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002b597-767e-4199-94b3-6b9c077be58d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.230543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e962ab-8207-4fe5-b068-4d5b37e3d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.231206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e962ab-8207-4fe5-b068-4d5b37e3d819 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.231490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e962ab-8207-4fe5-b068-4d5b37e3d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.231771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e962ab-8207-4fe5-b068-4d5b37e3d819 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.232521 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e962ab-8207-4fe5-b068-4d5b37e3d819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:12.232824 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e962ab-8207-4fe5-b068-4d5b37e3d819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.234517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e962ab-8207-4fe5-b068-4d5b37e3d819 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.251949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 992/1961] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:12.252143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 970/1962] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:25:12.252254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002b597-767e-4199-94b3-6b9c077be58d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.253229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e962ab-8207-4fe5-b068-4d5b37e3d819 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.261329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002b597-767e-4199-94b3-6b9c077be58d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.266792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e962ab-8207-4fe5-b068-4d5b37e3d819 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.269870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b6e4-42fb-43b0-af0e-1d49e6a1b7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.270813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b6e4-42fb-43b0-af0e-1d49e6a1b7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.271107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b6e4-42fb-43b0-af0e-1d49e6a1b7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.271422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b6e4-42fb-43b0-af0e-1d49e6a1b7b0 admin admin] PATH_INFO: `/v3/projects/a1e472192cea493398e2341086cf3e63/users/e8110372951948bca3169dcbdd90754e/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.272501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534898f6-baeb-4b1a-959d-4156a12fc234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.273513 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534898f6-baeb-4b1a-959d-4156a12fc234 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.273863 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534898f6-baeb-4b1a-959d-4156a12fc234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.274726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534898f6-baeb-4b1a-959d-4156a12fc234 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.275212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534898f6-baeb-4b1a-959d-4156a12fc234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.277542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534898f6-baeb-4b1a-959d-4156a12fc234 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.298066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344b6e4-42fb-43b0-af0e-1d49e6a1b7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e472192cea493398e2341086cf3e63, user_id=e8110372951948bca3169dcbdd90754e, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.301157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344b6e4-42fb-43b0-af0e-1d49e6a1b7b0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.325973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 971/1963] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:12 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:12.329913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534898f6-baeb-4b1a-959d-4156a12fc234 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.332625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 993/1964] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:12 2022] PUT /identity/v3/projects/a1e472192cea493398e2341086cf3e63/users/e8110372951948bca3169dcbdd90754e/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:12.336363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b6e4-42fb-43b0-af0e-1d49e6a1b7b0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.406823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534898f6-baeb-4b1a-959d-4156a12fc234 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.409840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b6e4-42fb-43b0-af0e-1d49e6a1b7b0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.416267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069c153-15e5-4a59-8838-4606acf24bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.416989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069c153-15e5-4a59-8838-4606acf24bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.417282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069c153-15e5-4a59-8838-4606acf24bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.417548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a108f2c-0a5f-43c4-80ef-40a10c7b88de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.417671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069c153-15e5-4a59-8838-4606acf24bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.418351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069c153-15e5-4a59-8838-4606acf24bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.418491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108f2c-0a5f-43c4-80ef-40a10c7b88de admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.418804 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108f2c-0a5f-43c4-80ef-40a10c7b88de admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.419157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108f2c-0a5f-43c4-80ef-40a10c7b88de admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.419991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a108f2c-0a5f-43c4-80ef-40a10c7b88de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.420863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069c153-15e5-4a59-8838-4606acf24bbd admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.422095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a108f2c-0a5f-43c4-80ef-40a10c7b88de admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.433133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 994/1965] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:12.437049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069c153-15e5-4a59-8838-4606acf24bbd admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.448912 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069c153-15e5-4a59-8838-4606acf24bbd admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.464388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 972/1966] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:12 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:12.467030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a108f2c-0a5f-43c4-80ef-40a10c7b88de admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.480879 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4da9-71e0-45e8-b96a-6cc23c607931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.482881 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4da9-71e0-45e8-b96a-6cc23c607931 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.483176 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4da9-71e0-45e8-b96a-6cc23c607931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.483458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4da9-71e0-45e8-b96a-6cc23c607931 admin admin] PATH_INFO: `/v3/projects/a1e472192cea493398e2341086cf3e63/users/e8110372951948bca3169dcbdd90754e/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.485794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4da9-71e0-45e8-b96a-6cc23c607931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e472192cea493398e2341086cf3e63, user_id=e8110372951948bca3169dcbdd90754e, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.489143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4da9-71e0-45e8-b96a-6cc23c607931 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.491235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a108f2c-0a5f-43c4-80ef-40a10c7b88de admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.500340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a15c-d7e6-4bf4-bcfc-8c2b4b13fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.501490 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a15c-d7e6-4bf4-bcfc-8c2b4b13fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.501925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a15c-d7e6-4bf4-bcfc-8c2b4b13fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.502417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a15c-d7e6-4bf4-bcfc-8c2b4b13fbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.503945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1a15c-d7e6-4bf4-bcfc-8c2b4b13fbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.507302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1a15c-d7e6-4bf4-bcfc-8c2b4b13fbf2 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.515387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 995/1967] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:12 2022] PUT /identity/v3/projects/a1e472192cea493398e2341086cf3e63/users/e8110372951948bca3169dcbdd90754e/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:12.517338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d5a66-ab98-4211-ac93-ac0af9677157 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.517338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d5a66-ab98-4211-ac93-ac0af9677157 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.518503 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d5a66-ab98-4211-ac93-ac0af9677157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.522887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 973/1968] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:12.526959 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a15c-d7e6-4bf4-bcfc-8c2b4b13fbf2 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.541507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a15c-d7e6-4bf4-bcfc-8c2b4b13fbf2 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.553533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-046d5a66-ab98-4211-ac93-ac0af9677157 None None] MFA Rules not processed for user `e8110372951948bca3169dcbdd90754e`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:12.554791 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-046d5a66-ab98-4211-ac93-ac0af9677157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:12.638451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 996/1969] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:12.657544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d5a66-ab98-4211-ac93-ac0af9677157 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.662363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-046d5a66-ab98-4211-ac93-ac0af9677157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:12.679778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ce5d-72c7-44bb-bb74-6b5f284a2721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.680580 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ce5d-72c7-44bb-bb74-6b5f284a2721 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.681204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ce5d-72c7-44bb-bb74-6b5f284a2721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.681558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ce5d-72c7-44bb-bb74-6b5f284a2721 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.684339 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06ce5d-72c7-44bb-bb74-6b5f284a2721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.687441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06ce5d-72c7-44bb-bb74-6b5f284a2721 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.726283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 974/1970] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:12.733201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ce5d-72c7-44bb-bb74-6b5f284a2721 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.744910 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ce5d-72c7-44bb-bb74-6b5f284a2721 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.747183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d5a66-ab98-4211-ac93-ac0af9677157 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:12.751721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b5b3-852c-4ad1-9251-b17ecef62f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.752964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b5b3-852c-4ad1-9251-b17ecef62f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.753418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b5b3-852c-4ad1-9251-b17ecef62f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.753849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b5b3-852c-4ad1-9251-b17ecef62f72 admin admin] PATH_INFO: `/v3/projects/d8433f0b66694cb49e876b0980e83929/users/57f115c0e7024057af21fc2932d24565/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.761686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3760b4-1fa5-44ae-b451-bb2fa5279275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:12.762561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3760b4-1fa5-44ae-b451-bb2fa5279275 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.762855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3760b4-1fa5-44ae-b451-bb2fa5279275 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.763143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3760b4-1fa5-44ae-b451-bb2fa5279275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.765187 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9d3760b4-1fa5-44ae-b451-bb2fa5279275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:12.784492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6b5b3-852c-4ad1-9251-b17ecef62f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8433f0b66694cb49e876b0980e83929, user_id=57f115c0e7024057af21fc2932d24565, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.787936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6b5b3-852c-4ad1-9251-b17ecef62f72 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.810935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 975/1971] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:12 2022] PUT /identity/v3/projects/d8433f0b66694cb49e876b0980e83929/users/57f115c0e7024057af21fc2932d24565/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:12.824126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a40e9-4fcc-4e2e-9051-c23b4a6964bb None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:12.825067 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a40e9-4fcc-4e2e-9051-c23b4a6964bb None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:12.825605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a40e9-4fcc-4e2e-9051-c23b4a6964bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:12.855556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3760b4-1fa5-44ae-b451-bb2fa5279275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:12.857513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3760b4-1fa5-44ae-b451-bb2fa5279275 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:12.861695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-8f2a40e9-4fcc-4e2e-9051-c23b4a6964bb None None] MFA Rules not processed for user `57f115c0e7024057af21fc2932d24565`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:12.863282 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8f2a40e9-4fcc-4e2e-9051-c23b4a6964bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:12.869038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 997/1972] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:12.957400 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 976/1973] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:12.962707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3760b4-1fa5-44ae-b451-bb2fa5279275 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:12.974190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3760b4-1fa5-44ae-b451-bb2fa5279275 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:13.039835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c413e-e5ad-46e7-b533-cd79c959a32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:13.040772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c413e-e5ad-46e7-b533-cd79c959a32a admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.041055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c413e-e5ad-46e7-b533-cd79c959a32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.041346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c413e-e5ad-46e7-b533-cd79c959a32a admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:13.042024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c413e-e5ad-46e7-b533-cd79c959a32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:13.044084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c413e-e5ad-46e7-b533-cd79c959a32a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:13.087628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 998/1974] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:12 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:13.088554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a40e9-4fcc-4e2e-9051-c23b4a6964bb None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:13.105211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a40e9-4fcc-4e2e-9051-c23b4a6964bb None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:13.178772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ab1d-9d71-4a61-8dc5-076285d00c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:13.179379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ab1d-9d71-4a61-8dc5-076285d00c7b admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.179724 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ab1d-9d71-4a61-8dc5-076285d00c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.180005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ab1d-9d71-4a61-8dc5-076285d00c7b admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:13.180948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1ab1d-9d71-4a61-8dc5-076285d00c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:13.183018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1ab1d-9d71-4a61-8dc5-076285d00c7b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:13.210855 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 977/1975] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:13 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:13.213319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c413e-e5ad-46e7-b533-cd79c959a32a admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:13.224257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c413e-e5ad-46e7-b533-cd79c959a32a admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:13.229521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c3ab-6d2e-499f-b6ac-3ef25a341bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:13.230299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c3ab-6d2e-499f-b6ac-3ef25a341bda admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.230659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c3ab-6d2e-499f-b6ac-3ef25a341bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.231005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c3ab-6d2e-499f-b6ac-3ef25a341bda admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:13.231807 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13c3ab-6d2e-499f-b6ac-3ef25a341bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:13.233480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13c3ab-6d2e-499f-b6ac-3ef25a341bda admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:13.248751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 999/1976] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:13.249612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ab1d-9d71-4a61-8dc5-076285d00c7b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:13.274011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ab1d-9d71-4a61-8dc5-076285d00c7b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:13.310271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe48cb5-270b-45c8-91e9-e3a261d4f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:13.310966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe48cb5-270b-45c8-91e9-e3a261d4f8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.311255 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe48cb5-270b-45c8-91e9-e3a261d4f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.311534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe48cb5-270b-45c8-91e9-e3a261d4f8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:13.312277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe48cb5-270b-45c8-91e9-e3a261d4f8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:13.313874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe48cb5-270b-45c8-91e9-e3a261d4f8f0 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:13.342158 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 978/1977] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:13.347347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c3ab-6d2e-499f-b6ac-3ef25a341bda admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:13.368876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c3ab-6d2e-499f-b6ac-3ef25a341bda admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:13.375635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c56636-00aa-4a35-bb68-179cf349dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:13.376542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c56636-00aa-4a35-bb68-179cf349dd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.377298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c56636-00aa-4a35-bb68-179cf349dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.377770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c56636-00aa-4a35-bb68-179cf349dd22 admin admin] PATH_INFO: `/v3/projects/c9aab886119f4cc69029199a1d860818/users/1162f76570b44ae48d0df8cb77ea66e8/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:13.410851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c56636-00aa-4a35-bb68-179cf349dd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9aab886119f4cc69029199a1d860818, user_id=1162f76570b44ae48d0df8cb77ea66e8, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:13.415261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c56636-00aa-4a35-bb68-179cf349dd22 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:13.441325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1000/1978] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:13 2022] PUT /identity/v3/projects/c9aab886119f4cc69029199a1d860818/users/1162f76570b44ae48d0df8cb77ea66e8/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:13.444485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497988c8-4397-48ec-bc9e-891f9d7f94df None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.444812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497988c8-4397-48ec-bc9e-891f9d7f94df None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.445096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497988c8-4397-48ec-bc9e-891f9d7f94df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:13.503330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-497988c8-4397-48ec-bc9e-891f9d7f94df None None] MFA Rules not processed for user `1162f76570b44ae48d0df8cb77ea66e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:13.504696 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-497988c8-4397-48ec-bc9e-891f9d7f94df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:13.606336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 979/1979] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:13.610476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c56636-00aa-4a35-bb68-179cf349dd22 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:13.675048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c56636-00aa-4a35-bb68-179cf349dd22 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:13.681765 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eabc6-c78b-4410-8824-4473993c3bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:13.682533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eabc6-c78b-4410-8824-4473993c3bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.682756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eabc6-c78b-4410-8824-4473993c3bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.683030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eabc6-c78b-4410-8824-4473993c3bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:13.683729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eabc6-c78b-4410-8824-4473993c3bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:13.686140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eabc6-c78b-4410-8824-4473993c3bc0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:13.727156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1001/1980] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:13 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:13.729381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497988c8-4397-48ec-bc9e-891f9d7f94df None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:13.742420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497988c8-4397-48ec-bc9e-891f9d7f94df None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:13.830953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46703766-247a-4387-b1d4-d189a4735439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:13.831658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46703766-247a-4387-b1d4-d189a4735439 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.832003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46703766-247a-4387-b1d4-d189a4735439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.832290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46703766-247a-4387-b1d4-d189a4735439 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:13.833002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46703766-247a-4387-b1d4-d189a4735439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:13.835954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46703766-247a-4387-b1d4-d189a4735439 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:13.891047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 980/1981] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:13 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:13.895384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eabc6-c78b-4410-8824-4473993c3bc0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:13.910493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eabc6-c78b-4410-8824-4473993c3bc0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:13.923981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72687313-1dfe-4641-a048-620b384f60c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:13.924644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72687313-1dfe-4641-a048-620b384f60c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.924931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72687313-1dfe-4641-a048-620b384f60c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.925208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72687313-1dfe-4641-a048-620b384f60c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:13.926190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72687313-1dfe-4641-a048-620b384f60c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:13.928697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72687313-1dfe-4641-a048-620b384f60c3 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:13.957461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1002/1982] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:13.963277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46703766-247a-4387-b1d4-d189a4735439 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:13.974251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46703766-247a-4387-b1d4-d189a4735439 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:13.984471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed532a9e-67fc-4ec9-8a52-e743159950bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:13.985987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed532a9e-67fc-4ec9-8a52-e743159950bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:13.985987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed532a9e-67fc-4ec9-8a52-e743159950bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:13.985987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed532a9e-67fc-4ec9-8a52-e743159950bc admin admin] PATH_INFO: `/v3/projects/927d3219136d4293841b2f5741afe55a/users/d398ee34011744a588d563a2444937f1/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:14.003367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed532a9e-67fc-4ec9-8a52-e743159950bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=927d3219136d4293841b2f5741afe55a, user_id=d398ee34011744a588d563a2444937f1, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:14.006840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed532a9e-67fc-4ec9-8a52-e743159950bc admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:14.023298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 981/1983] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:13 2022] PUT /identity/v3/projects/927d3219136d4293841b2f5741afe55a/users/d398ee34011744a588d563a2444937f1/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:14.027304 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72687313-1dfe-4641-a048-620b384f60c3 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:14.037685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72687313-1dfe-4641-a048-620b384f60c3 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:14.093179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e83a16-e710-4d64-96db-eb5a84e26849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:14.093979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e83a16-e710-4d64-96db-eb5a84e26849 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:14.094396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e83a16-e710-4d64-96db-eb5a84e26849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:14.094685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e83a16-e710-4d64-96db-eb5a84e26849 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:14.095398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e83a16-e710-4d64-96db-eb5a84e26849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:14.097607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e83a16-e710-4d64-96db-eb5a84e26849 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:14.107706 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1003/1984] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:14.111798 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed532a9e-67fc-4ec9-8a52-e743159950bc admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:14.125136 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed532a9e-67fc-4ec9-8a52-e743159950bc admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:14.131836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f80e0-ac51-4233-89f2-12f970115c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:14.133507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f80e0-ac51-4233-89f2-12f970115c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:14.133801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f80e0-ac51-4233-89f2-12f970115c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:14.134080 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f80e0-ac51-4233-89f2-12f970115c4f admin admin] PATH_INFO: `/v3/projects/927d3219136d4293841b2f5741afe55a/users/d398ee34011744a588d563a2444937f1/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:14.136265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f80e0-ac51-4233-89f2-12f970115c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=927d3219136d4293841b2f5741afe55a, user_id=d398ee34011744a588d563a2444937f1, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:14.140133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f80e0-ac51-4233-89f2-12f970115c4f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:14.154743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 982/1985] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:14 2022] PUT /identity/v3/projects/927d3219136d4293841b2f5741afe55a/users/d398ee34011744a588d563a2444937f1/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:14.166339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7ff8c-58e5-437c-8a44-821a64817359 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:14.167186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7ff8c-58e5-437c-8a44-821a64817359 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:14.167475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7ff8c-58e5-437c-8a44-821a64817359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:14.201799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fea7ff8c-58e5-437c-8a44-821a64817359 None None] MFA Rules not processed for user `d398ee34011744a588d563a2444937f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:14.203288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fea7ff8c-58e5-437c-8a44-821a64817359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:14.295134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1004/1986] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:14.308274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f80e0-ac51-4233-89f2-12f970115c4f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:14.397187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f80e0-ac51-4233-89f2-12f970115c4f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:14.407558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307bf3b-24df-443c-acb2-60c1109f2b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:14.408241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307bf3b-24df-443c-acb2-60c1109f2b84 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:14.408538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307bf3b-24df-443c-acb2-60c1109f2b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:14.409087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307bf3b-24df-443c-acb2-60c1109f2b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:14.468690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307bf3b-24df-443c-acb2-60c1109f2b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:14.470323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307bf3b-24df-443c-acb2-60c1109f2b84 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:14.501163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 983/1987] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:14.569662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7ff8c-58e5-437c-8a44-821a64817359 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:14.571717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fea7ff8c-58e5-437c-8a44-821a64817359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:14.589536 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7ff8c-58e5-437c-8a44-821a64817359 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:14.593783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd8ad7-d8e9-47d3-9529-001b146195bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:14.594779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd8ad7-d8e9-47d3-9529-001b146195bb service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:14.595274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd8ad7-d8e9-47d3-9529-001b146195bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:14.595739 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd8ad7-d8e9-47d3-9529-001b146195bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:14.659516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd8ad7-d8e9-47d3-9529-001b146195bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:14.660982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd8ad7-d8e9-47d3-9529-001b146195bb service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:14.673592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1005/1988] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:18.747992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307bf3b-24df-443c-acb2-60c1109f2b84 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:18.811075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307bf3b-24df-443c-acb2-60c1109f2b84 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:18.815572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:18.816456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:18.816718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:18.816989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] PATH_INFO: `/v3/users/57f115c0e7024057af21fc2932d24565` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:18.818815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f115c0e7024057af21fc2932d24565)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:18.820735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:18.866176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f115c0e7024057af21fc2932d24565'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:18.874904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f115c0e7024057af21fc2932d24565'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:18.875663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f115c0e7024057af21fc2932d24565'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:18.885445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f115c0e7024057af21fc2932d24565'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:18.897823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f115c0e7024057af21fc2932d24565'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:18.903976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 984/1989] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:18 2022] DELETE /identity/v3/users/57f115c0e7024057af21fc2932d24565 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:18.908471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb07f5-e319-443f-b5a9-626609e492d2 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:18.909272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb07f5-e319-443f-b5a9-626609e492d2 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:18.909272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb07f5-e319-443f-b5a9-626609e492d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:18.926903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f2eb07f5-e319-443f-b5a9-626609e492d2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:18.928655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f2eb07f5-e319-443f-b5a9-626609e492d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:18.988777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1006/1990] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:19.000015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:19.001532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:19.060296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd7879-b375-4b0d-ad26-85c98c2f4c95 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:19.063977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580aea2-f671-44e0-bd20-8abbc004d4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:19.064626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580aea2-f671-44e0-bd20-8abbc004d4fb service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:19.064913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580aea2-f671-44e0-bd20-8abbc004d4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:19.065192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580aea2-f671-44e0-bd20-8abbc004d4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:19.074388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580aea2-f671-44e0-bd20-8abbc004d4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:19.075822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580aea2-f671-44e0-bd20-8abbc004d4fb service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:19.085418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 985/1991] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:19.422003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb07f5-e319-443f-b5a9-626609e492d2 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:19.423909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f2eb07f5-e319-443f-b5a9-626609e492d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:19.437189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb07f5-e319-443f-b5a9-626609e492d2 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:19.447377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:19.447377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:19.447377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:19.447377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] PATH_INFO: `/v3/projects/d8433f0b66694cb49e876b0980e83929` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:19.447722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8433f0b66694cb49e876b0980e83929)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:19.449814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:19.509300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8433f0b66694cb49e876b0980e83929', 'request_id': 'req-ab051e45-ce73-427a-9be5-5b3087064445'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.516708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8433f0b66694cb49e876b0980e83929', 'request_id': 'req-ab051e45-ce73-427a-9be5-5b3087064445'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.523088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8433f0b66694cb49e876b0980e83929', 'request_id': 'req-ab051e45-ce73-427a-9be5-5b3087064445'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.534462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] The token cache is being invalidate because project d8433f0b66694cb49e876b0980e83929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:19.534755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.535418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.537094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1007/1992] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:19 2022] DELETE /identity/v3/projects/d8433f0b66694cb49e876b0980e83929 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:19.540929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580aea2-f671-44e0-bd20-8abbc004d4fb service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:19.550890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580aea2-f671-44e0-bd20-8abbc004d4fb service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:19.605611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:19.606832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:19.607110 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:19.607379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] PATH_INFO: `/v3/users/1162f76570b44ae48d0df8cb77ea66e8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:19.608586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1162f76570b44ae48d0df8cb77ea66e8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:19.610554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:19.666636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1162f76570b44ae48d0df8cb77ea66e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.673854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1162f76570b44ae48d0df8cb77ea66e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.674630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1162f76570b44ae48d0df8cb77ea66e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.681653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1162f76570b44ae48d0df8cb77ea66e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.692769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1162f76570b44ae48d0df8cb77ea66e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:19.699316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 986/1993] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:19 2022] DELETE /identity/v3/users/1162f76570b44ae48d0df8cb77ea66e8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:20.278657 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:20.280210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:20.294316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab051e45-ce73-427a-9be5-5b3087064445 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:20.363294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:20.364194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:20.364458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:20.364727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] PATH_INFO: `/v3/projects/c9aab886119f4cc69029199a1d860818` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:20.365976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9aab886119f4cc69029199a1d860818)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:20.367968 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:20.419510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9aab886119f4cc69029199a1d860818', 'request_id': 'req-61a80983-1830-4543-a872-c204108a5a16'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.427920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9aab886119f4cc69029199a1d860818', 'request_id': 'req-61a80983-1830-4543-a872-c204108a5a16'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.435502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9aab886119f4cc69029199a1d860818', 'request_id': 'req-61a80983-1830-4543-a872-c204108a5a16'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.447221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] The token cache is being invalidate because project c9aab886119f4cc69029199a1d860818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:20.447513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.448170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.450072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1008/1994] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:20 2022] DELETE /identity/v3/projects/c9aab886119f4cc69029199a1d860818 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:20.453984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:20.455574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:20.468502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ec0d2-b7f7-40ad-b55b-777975e599b2 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:20.536297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:20.538385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:20.538668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:20.539094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] PATH_INFO: `/v3/users/d398ee34011744a588d563a2444937f1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:20.540414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d398ee34011744a588d563a2444937f1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:20.542508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:20.561651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:20.563826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:20.594534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd398ee34011744a588d563a2444937f1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.603827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd398ee34011744a588d563a2444937f1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.604646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd398ee34011744a588d563a2444937f1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.612091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd398ee34011744a588d563a2444937f1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.624378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd398ee34011744a588d563a2444937f1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:20.624947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a80983-1830-4543-a872-c204108a5a16 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:20.628950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cec799-d86e-4562-ac88-4460fa790560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:20.629717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cec799-d86e-4562-ac88-4460fa790560 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:20.630087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cec799-d86e-4562-ac88-4460fa790560 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:20.631016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cec799-d86e-4562-ac88-4460fa790560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:20.632358 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 987/1995] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:20 2022] DELETE /identity/v3/users/d398ee34011744a588d563a2444937f1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:20.634881 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c5cec799-d86e-4562-ac88-4460fa790560 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:20.704995 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cec799-d86e-4562-ac88-4460fa790560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:20.706664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cec799-d86e-4562-ac88-4460fa790560 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:20.717708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1009/1996] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:20.929704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:20.931334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:21.018634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d702fd-5451-4d11-b10b-d719a2f5d49a admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.031148 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.032034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.032322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.032669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] PATH_INFO: `/v3/projects/927d3219136d4293841b2f5741afe55a` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.035280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=927d3219136d4293841b2f5741afe55a)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.038794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:21.100365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927d3219136d4293841b2f5741afe55a', 'request_id': 'req-ebba9c09-6944-462b-b89c-e4da674ad8be'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:21.108558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927d3219136d4293841b2f5741afe55a', 'request_id': 'req-ebba9c09-6944-462b-b89c-e4da674ad8be'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:21.126365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927d3219136d4293841b2f5741afe55a', 'request_id': 'req-ebba9c09-6944-462b-b89c-e4da674ad8be'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:21.140826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] The token cache is being invalidate because project 927d3219136d4293841b2f5741afe55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:21.141119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:21.141779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ebba9c09-6944-462b-b89c-e4da674ad8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:21.143489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 988/1997] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:20 2022] DELETE /identity/v3/projects/927d3219136d4293841b2f5741afe55a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:21.150255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b7b55-541f-47f8-b4b5-cce80f6fc508 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.150576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b7b55-541f-47f8-b4b5-cce80f6fc508 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.150895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b7b55-541f-47f8-b4b5-cce80f6fc508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.170186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a28b7b55-541f-47f8-b4b5-cce80f6fc508 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:21.171329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a28b7b55-541f-47f8-b4b5-cce80f6fc508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:21.231100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1010/1998] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:21.239386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4b68-551b-4392-8553-757db00cda8c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.239686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4b68-551b-4392-8553-757db00cda8c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.240032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4b68-551b-4392-8553-757db00cda8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.258626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-c8fd4b68-551b-4392-8553-757db00cda8c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:21.259813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c8fd4b68-551b-4392-8553-757db00cda8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:21.267808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 989/1999] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:21.272230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b7b55-541f-47f8-b4b5-cce80f6fc508 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:21.281770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b7b55-541f-47f8-b4b5-cce80f6fc508 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.286573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c1bd2-cf4d-4a0a-b054-85ee3b4b3a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.287752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c1bd2-cf4d-4a0a-b054-85ee3b4b3a18 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.288039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c1bd2-cf4d-4a0a-b054-85ee3b4b3a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.288316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c1bd2-cf4d-4a0a-b054-85ee3b4b3a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.289038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c1bd2-cf4d-4a0a-b054-85ee3b4b3a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:21.289342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c1bd2-cf4d-4a0a-b054-85ee3b4b3a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.290957 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c1bd2-cf4d-4a0a-b054-85ee3b4b3a18 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:21.307589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1011/2000] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:25:21.309091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4b68-551b-4392-8553-757db00cda8c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:21.318025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4b68-551b-4392-8553-757db00cda8c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.323074 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2a301-9de8-4296-bcef-6006d3516f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.323746 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2a301-9de8-4296-bcef-6006d3516f56 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.324031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2a301-9de8-4296-bcef-6006d3516f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.324309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2a301-9de8-4296-bcef-6006d3516f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.325229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2a301-9de8-4296-bcef-6006d3516f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.327637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2a301-9de8-4296-bcef-6006d3516f56 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:21.354986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 990/2001] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:21 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:21.358923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c1bd2-cf4d-4a0a-b054-85ee3b4b3a18 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:21.371196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c1bd2-cf4d-4a0a-b054-85ee3b4b3a18 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.433454 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c92193-fe45-45d3-a1c1-73809ef1311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.434169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c92193-fe45-45d3-a1c1-73809ef1311c admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.434459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c92193-fe45-45d3-a1c1-73809ef1311c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.434892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c92193-fe45-45d3-a1c1-73809ef1311c admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.435658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c92193-fe45-45d3-a1c1-73809ef1311c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.437626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c92193-fe45-45d3-a1c1-73809ef1311c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:21.459945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1012/2002] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:21 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:21.463606 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2a301-9de8-4296-bcef-6006d3516f56 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:21.475923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2a301-9de8-4296-bcef-6006d3516f56 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.480753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32681ef-26d1-409f-95eb-bcebba06fd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.481423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32681ef-26d1-409f-95eb-bcebba06fd2b admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.481707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32681ef-26d1-409f-95eb-bcebba06fd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.482011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32681ef-26d1-409f-95eb-bcebba06fd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.482798 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32681ef-26d1-409f-95eb-bcebba06fd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.484384 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32681ef-26d1-409f-95eb-bcebba06fd2b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:21.496499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 991/2003] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:21.500806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c92193-fe45-45d3-a1c1-73809ef1311c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:21.511001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c92193-fe45-45d3-a1c1-73809ef1311c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.515628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dfdba-fdce-4140-95cf-8f042f2c65e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.516294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dfdba-fdce-4140-95cf-8f042f2c65e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.516578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dfdba-fdce-4140-95cf-8f042f2c65e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.516859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dfdba-fdce-4140-95cf-8f042f2c65e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.517576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dfdba-fdce-4140-95cf-8f042f2c65e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.519202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dfdba-fdce-4140-95cf-8f042f2c65e2 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:21.529391 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1013/2004] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:21.533806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32681ef-26d1-409f-95eb-bcebba06fd2b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:21.544400 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32681ef-26d1-409f-95eb-bcebba06fd2b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.548986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35f9fd-75fe-4832-bc6b-12c9db8edc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.549875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35f9fd-75fe-4832-bc6b-12c9db8edc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.550204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35f9fd-75fe-4832-bc6b-12c9db8edc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.550479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35f9fd-75fe-4832-bc6b-12c9db8edc65 admin admin] PATH_INFO: `/v3/projects/061aca5f56fc463c8cbceb4fa553fe15/users/2bd67557be684610924a1366b7214b4a/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.578168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35f9fd-75fe-4832-bc6b-12c9db8edc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061aca5f56fc463c8cbceb4fa553fe15, user_id=2bd67557be684610924a1366b7214b4a, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.578168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35f9fd-75fe-4832-bc6b-12c9db8edc65 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:21.593441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 992/2005] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:21 2022] PUT /identity/v3/projects/061aca5f56fc463c8cbceb4fa553fe15/users/2bd67557be684610924a1366b7214b4a/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:21.605481 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e83cf-280d-4e69-8aa0-edf5da7074cd None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.605840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e83cf-280d-4e69-8aa0-edf5da7074cd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.606033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e83cf-280d-4e69-8aa0-edf5da7074cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.634118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9c3e83cf-280d-4e69-8aa0-edf5da7074cd None None] MFA Rules not processed for user `2bd67557be684610924a1366b7214b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:21.635383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9c3e83cf-280d-4e69-8aa0-edf5da7074cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:21.716471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1014/2006] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:21.721287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35f9fd-75fe-4832-bc6b-12c9db8edc65 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:21.803983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35f9fd-75fe-4832-bc6b-12c9db8edc65 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.809001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee447b4-9395-4cda-95fb-d029fd86ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.809666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee447b4-9395-4cda-95fb-d029fd86ac58 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.809945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee447b4-9395-4cda-95fb-d029fd86ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.810259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee447b4-9395-4cda-95fb-d029fd86ac58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.810942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee447b4-9395-4cda-95fb-d029fd86ac58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.812868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee447b4-9395-4cda-95fb-d029fd86ac58 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:21.843486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 993/2007] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:21 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:21.844824 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e83cf-280d-4e69-8aa0-edf5da7074cd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:21.857541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e83cf-280d-4e69-8aa0-edf5da7074cd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.937805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7194-26bc-4a49-abb6-a5fdf73ef128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.939421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7194-26bc-4a49-abb6-a5fdf73ef128 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.939817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7194-26bc-4a49-abb6-a5fdf73ef128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.940216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7194-26bc-4a49-abb6-a5fdf73ef128 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.941541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7194-26bc-4a49-abb6-a5fdf73ef128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.944844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7194-26bc-4a49-abb6-a5fdf73ef128 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:21.973708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1015/2008] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:21 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:21.975320 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee447b4-9395-4cda-95fb-d029fd86ac58 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:21.986626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee447b4-9395-4cda-95fb-d029fd86ac58 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:21.992869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bf8a2-61a1-4da5-bacc-c3cc6738e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:21.993791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bf8a2-61a1-4da5-bacc-c3cc6738e532 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:21.994064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bf8a2-61a1-4da5-bacc-c3cc6738e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:21.994361 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bf8a2-61a1-4da5-bacc-c3cc6738e532 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:21.995107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bf8a2-61a1-4da5-bacc-c3cc6738e532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:21.996713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bf8a2-61a1-4da5-bacc-c3cc6738e532 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:22.012769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 994/2009] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:22.016820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7194-26bc-4a49-abb6-a5fdf73ef128 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:22.033129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7194-26bc-4a49-abb6-a5fdf73ef128 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:22.040073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe82b2-c7de-49c7-8bf5-7f7f1b5f3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:22.041255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe82b2-c7de-49c7-8bf5-7f7f1b5f3615 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:22.041746 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe82b2-c7de-49c7-8bf5-7f7f1b5f3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:22.042544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe82b2-c7de-49c7-8bf5-7f7f1b5f3615 admin admin] PATH_INFO: `/v3/projects/944dd9a4d90f4a52b9ae3b37f2f12649/users/f77d854b804945cba23a52e7ffbfb452/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:22.063019 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe82b2-c7de-49c7-8bf5-7f7f1b5f3615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944dd9a4d90f4a52b9ae3b37f2f12649, user_id=f77d854b804945cba23a52e7ffbfb452, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:22.066599 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe82b2-c7de-49c7-8bf5-7f7f1b5f3615 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:22.093235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1016/2010] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:22 2022] PUT /identity/v3/projects/944dd9a4d90f4a52b9ae3b37f2f12649/users/f77d854b804945cba23a52e7ffbfb452/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:22.097389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bf8a2-61a1-4da5-bacc-c3cc6738e532 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:22.113039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bf8a2-61a1-4da5-bacc-c3cc6738e532 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:22.231037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbef40-c7f7-406f-95c2-016a43b20b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:22.231787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbef40-c7f7-406f-95c2-016a43b20b3c admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:22.232628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbef40-c7f7-406f-95c2-016a43b20b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:22.232984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbef40-c7f7-406f-95c2-016a43b20b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:22.233795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbef40-c7f7-406f-95c2-016a43b20b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:22.238175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbef40-c7f7-406f-95c2-016a43b20b3c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:22.256085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 995/2011] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:22.260580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe82b2-c7de-49c7-8bf5-7f7f1b5f3615 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:22.272789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe82b2-c7de-49c7-8bf5-7f7f1b5f3615 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:22.282401 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e22e-5f88-46b5-8841-bed2ec3faefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:22.284818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e22e-5f88-46b5-8841-bed2ec3faefc admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:22.285294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e22e-5f88-46b5-8841-bed2ec3faefc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:22.285837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e22e-5f88-46b5-8841-bed2ec3faefc admin admin] PATH_INFO: `/v3/projects/944dd9a4d90f4a52b9ae3b37f2f12649/users/f77d854b804945cba23a52e7ffbfb452/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:22.289942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306e22e-5f88-46b5-8841-bed2ec3faefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=944dd9a4d90f4a52b9ae3b37f2f12649, user_id=f77d854b804945cba23a52e7ffbfb452, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:22.292802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306e22e-5f88-46b5-8841-bed2ec3faefc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:22.311003 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1017/2012] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:22 2022] PUT /identity/v3/projects/944dd9a4d90f4a52b9ae3b37f2f12649/users/f77d854b804945cba23a52e7ffbfb452/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:22.319253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892a6c-0658-4999-850e-23e6d4cd2310 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:22.319845 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892a6c-0658-4999-850e-23e6d4cd2310 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:22.319845 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892a6c-0658-4999-850e-23e6d4cd2310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:22.348268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-5b892a6c-0658-4999-850e-23e6d4cd2310 None None] MFA Rules not processed for user `f77d854b804945cba23a52e7ffbfb452`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:22.350355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5b892a6c-0658-4999-850e-23e6d4cd2310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:22.439870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 996/2013] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:22.453006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e22e-5f88-46b5-8841-bed2ec3faefc admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:22.457332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6306e22e-5f88-46b5-8841-bed2ec3faefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:22.569229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e22e-5f88-46b5-8841-bed2ec3faefc admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:22.579118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6f9b0-149b-4fb5-a075-65a48a1b44db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:22.580053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6f9b0-149b-4fb5-a075-65a48a1b44db service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:22.580513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6f9b0-149b-4fb5-a075-65a48a1b44db service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:22.581420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6f9b0-149b-4fb5-a075-65a48a1b44db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:22.606748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6f9b0-149b-4fb5-a075-65a48a1b44db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:22.610587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6f9b0-149b-4fb5-a075-65a48a1b44db service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:22.641517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1018/2014] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:22.753140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892a6c-0658-4999-850e-23e6d4cd2310 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:22.789863 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892a6c-0658-4999-850e-23e6d4cd2310 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:22.799550 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc599d4f-e6c6-41c9-9fd6-c52328e15d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:22.800558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc599d4f-e6c6-41c9-9fd6-c52328e15d98 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:22.801445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc599d4f-e6c6-41c9-9fd6-c52328e15d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:22.801876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc599d4f-e6c6-41c9-9fd6-c52328e15d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:22.876624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc599d4f-e6c6-41c9-9fd6-c52328e15d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:22.878663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc599d4f-e6c6-41c9-9fd6-c52328e15d98 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:22.897048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 997/2015] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:37.380271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6f9b0-149b-4fb5-a075-65a48a1b44db service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:37.445178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc599d4f-e6c6-41c9-9fd6-c52328e15d98 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:37.447032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fc599d4f-e6c6-41c9-9fd6-c52328e15d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:37.462358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6f9b0-149b-4fb5-a075-65a48a1b44db service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:37.475052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:37.475052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:37.475052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:37.475052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] PATH_INFO: `/v3/users/2bd67557be684610924a1366b7214b4a` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:37.475635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd67557be684610924a1366b7214b4a)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:37.475635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:37.531786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd67557be684610924a1366b7214b4a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.532325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc599d4f-e6c6-41c9-9fd6-c52328e15d98 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:37.537740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:37.538674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:37.538968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:37.539209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] PATH_INFO: `/v3/users/5b1d1b2e34cc4cdda0a7c1bcc6a82a01` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:37.539369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd67557be684610924a1366b7214b4a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.540388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1d1b2e34cc4cdda0a7c1bcc6a82a01)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:37.542379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:37.548000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd67557be684610924a1366b7214b4a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.548721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd67557be684610924a1366b7214b4a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.549467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8950a98b-fee1-4e6d-93ac-89cddb85bbcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd67557be684610924a1366b7214b4a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.566984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1019/2016] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:37 2022] DELETE /identity/v3/users/2bd67557be684610924a1366b7214b4a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:37.571451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a1538-70ed-49fc-a393-3337d1a3f71f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:37.571911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a1538-70ed-49fc-a393-3337d1a3f71f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:37.572252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a1538-70ed-49fc-a393-3337d1a3f71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:37.591643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-af4a1538-70ed-49fc-a393-3337d1a3f71f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:37.592479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1d1b2e34cc4cdda0a7c1bcc6a82a01'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.592841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-af4a1538-70ed-49fc-a393-3337d1a3f71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:37.602448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1d1b2e34cc4cdda0a7c1bcc6a82a01'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.603138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1d1b2e34cc4cdda0a7c1bcc6a82a01'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.609829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1d1b2e34cc4cdda0a7c1bcc6a82a01'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.623184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1d1b2e34cc4cdda0a7c1bcc6a82a01'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.629346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 998/2017] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:37 2022] DELETE /identity/v3/users/5b1d1b2e34cc4cdda0a7c1bcc6a82a01 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:37.655201 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1020/2018] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:37.666200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:37.667560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:37.724507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbdf2-099c-4af5-bc85-dfca83f25f21 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:37.728217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cd00f-7125-484d-a6d2-667c0bc454db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:37.728808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd00f-7125-484d-a6d2-667c0bc454db service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:37.729092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd00f-7125-484d-a6d2-667c0bc454db service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:37.729370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd00f-7125-484d-a6d2-667c0bc454db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:37.802842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cd00f-7125-484d-a6d2-667c0bc454db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:37.804285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cd00f-7125-484d-a6d2-667c0bc454db service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:37.814951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 999/2019] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:37.815858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a1538-70ed-49fc-a393-3337d1a3f71f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:37.818136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-af4a1538-70ed-49fc-a393-3337d1a3f71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:37.838233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a1538-70ed-49fc-a393-3337d1a3f71f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:37.847577 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:37.848468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:37.848796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:37.849251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] PATH_INFO: `/v3/projects/0745835d450343598602d04226bc2b72` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:37.850987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0745835d450343598602d04226bc2b72)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:37.853086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:37.901757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0745835d450343598602d04226bc2b72', 'request_id': 'req-04aa4043-ef58-486c-b2fa-d7adea982069'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.910312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0745835d450343598602d04226bc2b72', 'request_id': 'req-04aa4043-ef58-486c-b2fa-d7adea982069'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.917874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0745835d450343598602d04226bc2b72', 'request_id': 'req-04aa4043-ef58-486c-b2fa-d7adea982069'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.928903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] The token cache is being invalidate because project 0745835d450343598602d04226bc2b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:37.929196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.929868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04aa4043-ef58-486c-b2fa-d7adea982069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:37.934169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1021/2020] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:37 2022] DELETE /identity/v3/projects/0745835d450343598602d04226bc2b72 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:37.936512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4371264-dc6f-4135-bc72-5b9417e81fd7 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:37.937372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4371264-dc6f-4135-bc72-5b9417e81fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:37.937820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4371264-dc6f-4135-bc72-5b9417e81fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:37.958968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e4371264-dc6f-4135-bc72-5b9417e81fd7 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:37.960165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e4371264-dc6f-4135-bc72-5b9417e81fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.030155 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1000/2021] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:38.036933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c83a-f03d-431c-8699-5d080f1823c2 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.037489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c83a-f03d-431c-8699-5d080f1823c2 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.037964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c83a-f03d-431c-8699-5d080f1823c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.058620 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-3162c83a-f03d-431c-8699-5d080f1823c2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:38.059827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3162c83a-f03d-431c-8699-5d080f1823c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.074622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1022/2022] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:38.079491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4371264-dc6f-4135-bc72-5b9417e81fd7 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.095980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4371264-dc6f-4135-bc72-5b9417e81fd7 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.100832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162c83a-f03d-431c-8699-5d080f1823c2 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.102215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3162c83a-f03d-431c-8699-5d080f1823c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.103811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646b371-d30b-4fee-a9ac-8ad12e94eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.104548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646b371-d30b-4fee-a9ac-8ad12e94eebb admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.104900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646b371-d30b-4fee-a9ac-8ad12e94eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.105266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646b371-d30b-4fee-a9ac-8ad12e94eebb admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.106050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646b371-d30b-4fee-a9ac-8ad12e94eebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:38.106487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646b371-d30b-4fee-a9ac-8ad12e94eebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.108867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646b371-d30b-4fee-a9ac-8ad12e94eebb admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.117013 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162c83a-f03d-431c-8699-5d080f1823c2 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.122603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.123477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.123761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.127242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] PATH_INFO: `/v3/projects/061aca5f56fc463c8cbceb4fa553fe15` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.127671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1001/2023] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:25:38.127835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061aca5f56fc463c8cbceb4fa553fe15)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.127835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.128326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646b371-d30b-4fee-a9ac-8ad12e94eebb admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.138033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646b371-d30b-4fee-a9ac-8ad12e94eebb admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.142828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b863f34-9364-448f-ac1d-4cea6686da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.143494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b863f34-9364-448f-ac1d-4cea6686da6e admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.143779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b863f34-9364-448f-ac1d-4cea6686da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.144064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b863f34-9364-448f-ac1d-4cea6686da6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.144762 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b863f34-9364-448f-ac1d-4cea6686da6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.147419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b863f34-9364-448f-ac1d-4cea6686da6e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.179857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1002/2024] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:38 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:38.180137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061aca5f56fc463c8cbceb4fa553fe15', 'request_id': 'req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.181532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b863f34-9364-448f-ac1d-4cea6686da6e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.189285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061aca5f56fc463c8cbceb4fa553fe15', 'request_id': 'req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.196362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061aca5f56fc463c8cbceb4fa553fe15', 'request_id': 'req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.209273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] The token cache is being invalidate because project 061aca5f56fc463c8cbceb4fa553fe15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:38.209779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.210954 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.213016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1023/2025] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:38 2022] DELETE /identity/v3/projects/061aca5f56fc463c8cbceb4fa553fe15 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:38.217186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.218749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.277063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b863f34-9364-448f-ac1d-4cea6686da6e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.282827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44247d8-9cb9-4e90-8b3e-e80d85e35d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.283748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44247d8-9cb9-4e90-8b3e-e80d85e35d92 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.284295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44247d8-9cb9-4e90-8b3e-e80d85e35d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.284620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44247d8-9cb9-4e90-8b3e-e80d85e35d92 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.285312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44247d8-9cb9-4e90-8b3e-e80d85e35d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.294703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44247d8-9cb9-4e90-8b3e-e80d85e35d92 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.299922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e9267-93e2-47fb-8d2a-8c5de08666d2 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.317386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1003/2026] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:38 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:38.318869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.319802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.320122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.320443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] PATH_INFO: `/v3/users/f77d854b804945cba23a52e7ffbfb452` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.321459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44247d8-9cb9-4e90-8b3e-e80d85e35d92 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.322289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77d854b804945cba23a52e7ffbfb452)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.323354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a44247d8-9cb9-4e90-8b3e-e80d85e35d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.324465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.337489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44247d8-9cb9-4e90-8b3e-e80d85e35d92 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.343362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4949bcf-c388-4a78-8172-25bed5aec480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.344049 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4949bcf-c388-4a78-8172-25bed5aec480 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.344364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4949bcf-c388-4a78-8172-25bed5aec480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.344733 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4949bcf-c388-4a78-8172-25bed5aec480 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.345461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4949bcf-c388-4a78-8172-25bed5aec480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.347205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4949bcf-c388-4a78-8172-25bed5aec480 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.362416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1004/2027] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:38.364020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4949bcf-c388-4a78-8172-25bed5aec480 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.375827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4949bcf-c388-4a78-8172-25bed5aec480 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.381951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205cfe0-8741-4351-84b9-acc4b46b4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.382860 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205cfe0-8741-4351-84b9-acc4b46b4aee admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.383186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205cfe0-8741-4351-84b9-acc4b46b4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.383511 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205cfe0-8741-4351-84b9-acc4b46b4aee admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.384305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205cfe0-8741-4351-84b9-acc4b46b4aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.386317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205cfe0-8741-4351-84b9-acc4b46b4aee admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.390254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77d854b804945cba23a52e7ffbfb452'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.402201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1005/2028] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:38.402426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77d854b804945cba23a52e7ffbfb452'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.403683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205cfe0-8741-4351-84b9-acc4b46b4aee admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.410249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77d854b804945cba23a52e7ffbfb452'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.411985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77d854b804945cba23a52e7ffbfb452'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.413280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e2e0238b-7385-40b6-a7fc-79e8d432b371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77d854b804945cba23a52e7ffbfb452'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.416834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205cfe0-8741-4351-84b9-acc4b46b4aee admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.422894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff81da9-cf70-4fd5-9dbe-f5bee06f4046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.424092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81da9-cf70-4fd5-9dbe-f5bee06f4046 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.424516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81da9-cf70-4fd5-9dbe-f5bee06f4046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.424986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81da9-cf70-4fd5-9dbe-f5bee06f4046 admin admin] PATH_INFO: `/v3/projects/d5fefe4c756c4befacd17ba722e29064/users/8d6a363d7a5749e3af4f07761395d159/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.436026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1024/2029] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:38 2022] DELETE /identity/v3/users/f77d854b804945cba23a52e7ffbfb452 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:38.450053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff81da9-cf70-4fd5-9dbe-f5bee06f4046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fefe4c756c4befacd17ba722e29064, user_id=8d6a363d7a5749e3af4f07761395d159, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.453008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff81da9-cf70-4fd5-9dbe-f5bee06f4046 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.470785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1006/2030] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:38 2022] PUT /identity/v3/projects/d5fefe4c756c4befacd17ba722e29064/users/8d6a363d7a5749e3af4f07761395d159/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:38.488691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f0263-8839-4786-af84-fa956acff65a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.489031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f0263-8839-4786-af84-fa956acff65a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.489382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f0263-8839-4786-af84-fa956acff65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.525490 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-643f0263-8839-4786-af84-fa956acff65a None None] MFA Rules not processed for user `8d6a363d7a5749e3af4f07761395d159`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:38.527285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-643f0263-8839-4786-af84-fa956acff65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.546418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff81da9-cf70-4fd5-9dbe-f5bee06f4046 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.548604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cff81da9-cf70-4fd5-9dbe-f5bee06f4046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.609764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1025/2031] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:38.623443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f0263-8839-4786-af84-fa956acff65a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.625057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-643f0263-8839-4786-af84-fa956acff65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.706676 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff81da9-cf70-4fd5-9dbe-f5bee06f4046 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.722128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.723054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.723312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.724199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] PATH_INFO: `/v3/users/24e6f38654d7463c81a4a36f3a101ff9` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.725483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e6f38654d7463c81a4a36f3a101ff9)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.728839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.786727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f0263-8839-4786-af84-fa956acff65a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.793406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99b86c-f078-43fa-9924-4ee2e8e35dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.794687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b86c-f078-43fa-9924-4ee2e8e35dcc service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.795008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b86c-f078-43fa-9924-4ee2e8e35dcc service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.795375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b86c-f078-43fa-9924-4ee2e8e35dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.804852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99b86c-f078-43fa-9924-4ee2e8e35dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.806981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99b86c-f078-43fa-9924-4ee2e8e35dcc service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.813590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e6f38654d7463c81a4a36f3a101ff9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.818369 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1026/2032] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:38.824034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e6f38654d7463c81a4a36f3a101ff9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.825000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e6f38654d7463c81a4a36f3a101ff9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.834781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e6f38654d7463c81a4a36f3a101ff9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.849491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6a7767c7-0e8b-4310-8f78-f58ed42d1fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e6f38654d7463c81a4a36f3a101ff9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:38.854224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99b86c-f078-43fa-9924-4ee2e8e35dcc service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.855981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3d99b86c-f078-43fa-9924-4ee2e8e35dcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.859769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1007/2033] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:38 2022] DELETE /identity/v3/users/24e6f38654d7463c81a4a36f3a101ff9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:38.861534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1c1e3-20de-4660-9172-195fc7287dab None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.862266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1c1e3-20de-4660-9172-195fc7287dab None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.862722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1c1e3-20de-4660-9172-195fc7287dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.874464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99b86c-f078-43fa-9924-4ee2e8e35dcc service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:38.897046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bae1c1e3-20de-4660-9172-195fc7287dab None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:38.898315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bae1c1e3-20de-4660-9172-195fc7287dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:38.940194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:38.941843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:38.942517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:38.943398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] PATH_INFO: `/v3/projects/944dd9a4d90f4a52b9ae3b37f2f12649` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:38.945120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944dd9a4d90f4a52b9ae3b37f2f12649)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:38.948535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:38.962974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1008/2034] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:38.973157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1c1e3-20de-4660-9172-195fc7287dab None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:38.975835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bae1c1e3-20de-4660-9172-195fc7287dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:39.014146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944dd9a4d90f4a52b9ae3b37f2f12649', 'request_id': 'req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.022791 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944dd9a4d90f4a52b9ae3b37f2f12649', 'request_id': 'req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.030669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944dd9a4d90f4a52b9ae3b37f2f12649', 'request_id': 'req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.037589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1c1e3-20de-4660-9172-195fc7287dab None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.044266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] The token cache is being invalidate because project 944dd9a4d90f4a52b9ae3b37f2f12649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:39.044556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.045258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b8b684a1-8474-423a-aa6c-73b7c1d19ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.047245 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1027/2035] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:38 2022] DELETE /identity/v3/projects/944dd9a4d90f4a52b9ae3b37f2f12649 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:39.052253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583936d-d518-4dae-bd10-615ad2035825 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.052541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583936d-d518-4dae-bd10-615ad2035825 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.052817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583936d-d518-4dae-bd10-615ad2035825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.072098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-7583936d-d518-4dae-bd10-615ad2035825 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:39.073813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7583936d-d518-4dae-bd10-615ad2035825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:39.090985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a25b3-4022-4fe0-8038-ec9f86b45ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.091649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a25b3-4022-4fe0-8038-ec9f86b45ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.091986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a25b3-4022-4fe0-8038-ec9f86b45ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.092377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a25b3-4022-4fe0-8038-ec9f86b45ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.104075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1f4a25b3-4022-4fe0-8038-ec9f86b45ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:39.162138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1028/2036] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:39.165848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c997c7-99a9-42df-a866-fd6337ae9be2 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.166493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c997c7-99a9-42df-a866-fd6337ae9be2 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.166778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c997c7-99a9-42df-a866-fd6337ae9be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.194471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a25b3-4022-4fe0-8038-ec9f86b45ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.194710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d7c997c7-99a9-42df-a866-fd6337ae9be2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:39.196205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d7c997c7-99a9-42df-a866-fd6337ae9be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:39.196371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a25b3-4022-4fe0-8038-ec9f86b45ed6 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.207130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1029/2037] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:39.212738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c997c7-99a9-42df-a866-fd6337ae9be2 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.224452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c997c7-99a9-42df-a866-fd6337ae9be2 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.226447 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1009/2038] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:39.229388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac03ba-98b7-49c1-bde8-a38059dec37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.230055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac03ba-98b7-49c1-bde8-a38059dec37f admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.230443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac03ba-98b7-49c1-bde8-a38059dec37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.230647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac03ba-98b7-49c1-bde8-a38059dec37f admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.231475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac03ba-98b7-49c1-bde8-a38059dec37f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:39.231668 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac03ba-98b7-49c1-bde8-a38059dec37f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.233269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac03ba-98b7-49c1-bde8-a38059dec37f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.253165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1030/2039] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:25:39.257974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a25b3-4022-4fe0-8038-ec9f86b45ed6 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.269870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a25b3-4022-4fe0-8038-ec9f86b45ed6 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.277994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770011fb-1241-4c56-b9f2-4fbd3a8c57bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.279924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770011fb-1241-4c56-b9f2-4fbd3a8c57bb admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.280184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770011fb-1241-4c56-b9f2-4fbd3a8c57bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.280473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770011fb-1241-4c56-b9f2-4fbd3a8c57bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.281232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770011fb-1241-4c56-b9f2-4fbd3a8c57bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.283693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770011fb-1241-4c56-b9f2-4fbd3a8c57bb admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.345471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1010/2040] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:39 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:39.346639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac03ba-98b7-49c1-bde8-a38059dec37f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.357833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac03ba-98b7-49c1-bde8-a38059dec37f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.417760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861a30b-5f24-4a1c-a5cd-662eabb80d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.418514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861a30b-5f24-4a1c-a5cd-662eabb80d32 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.418843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861a30b-5f24-4a1c-a5cd-662eabb80d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.419069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861a30b-5f24-4a1c-a5cd-662eabb80d32 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.419958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861a30b-5f24-4a1c-a5cd-662eabb80d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.421898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861a30b-5f24-4a1c-a5cd-662eabb80d32 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.442572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1031/2041] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:39 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:39.446501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770011fb-1241-4c56-b9f2-4fbd3a8c57bb admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.456567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770011fb-1241-4c56-b9f2-4fbd3a8c57bb admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.461265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5d598-95f3-4554-9246-f8fe3af66bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.461929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d598-95f3-4554-9246-f8fe3af66bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.462261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d598-95f3-4554-9246-f8fe3af66bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.462579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d598-95f3-4554-9246-f8fe3af66bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.463271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5d598-95f3-4554-9246-f8fe3af66bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.464874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5d598-95f3-4554-9246-f8fe3af66bc5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.479925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1011/2042] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:39.486719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861a30b-5f24-4a1c-a5cd-662eabb80d32 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.496587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861a30b-5f24-4a1c-a5cd-662eabb80d32 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.501202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4a2ba-5207-4a05-b84c-abef8d3bc81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.501864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4a2ba-5207-4a05-b84c-abef8d3bc81c admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.502177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4a2ba-5207-4a05-b84c-abef8d3bc81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.502462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4a2ba-5207-4a05-b84c-abef8d3bc81c admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.503184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4a2ba-5207-4a05-b84c-abef8d3bc81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.505320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4a2ba-5207-4a05-b84c-abef8d3bc81c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.515422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1032/2043] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:39.519634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5d598-95f3-4554-9246-f8fe3af66bc5 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.530789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4a2ba-5207-4a05-b84c-abef8d3bc81c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.531094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5d598-95f3-4554-9246-f8fe3af66bc5 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.533355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c6a4a2ba-5207-4a05-b84c-abef8d3bc81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:39.536956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c6ee3-360f-4145-bf76-a75bf38bf5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.538161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6ee3-360f-4145-bf76-a75bf38bf5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.538460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6ee3-360f-4145-bf76-a75bf38bf5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.538740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6ee3-360f-4145-bf76-a75bf38bf5d8 admin admin] PATH_INFO: `/v3/projects/24f3f0674bdc45309c26ebc4d6fa1e23/users/6379a561767a4590a15cb26339a7b885/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.552358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4a2ba-5207-4a05-b84c-abef8d3bc81c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.557320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.557421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c6ee3-360f-4145-bf76-a75bf38bf5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f3f0674bdc45309c26ebc4d6fa1e23, user_id=6379a561767a4590a15cb26339a7b885, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.558196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.558484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.558768 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] PATH_INFO: `/v3/projects/e53d9fbfc82246fb9dd63ed27638222d` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.559914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e53d9fbfc82246fb9dd63ed27638222d)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.560075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c6ee3-360f-4145-bf76-a75bf38bf5d8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.561769 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.574063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1012/2044] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:39 2022] PUT /identity/v3/projects/24f3f0674bdc45309c26ebc4d6fa1e23/users/6379a561767a4590a15cb26339a7b885/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:39.585810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ae390-3a3c-4df7-b371-e74f910c7d89 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.586124 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ae390-3a3c-4df7-b371-e74f910c7d89 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.586434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ae390-3a3c-4df7-b371-e74f910c7d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.611589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e53d9fbfc82246fb9dd63ed27638222d', 'request_id': 'req-e52177eb-251f-42bc-a661-bcd951b0ca50'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.611834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-436ae390-3a3c-4df7-b371-e74f910c7d89 None None] MFA Rules not processed for user `6379a561767a4590a15cb26339a7b885`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:39.613053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-436ae390-3a3c-4df7-b371-e74f910c7d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:39.619360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e53d9fbfc82246fb9dd63ed27638222d', 'request_id': 'req-e52177eb-251f-42bc-a661-bcd951b0ca50'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.625923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e53d9fbfc82246fb9dd63ed27638222d', 'request_id': 'req-e52177eb-251f-42bc-a661-bcd951b0ca50'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.635802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] The token cache is being invalidate because project e53d9fbfc82246fb9dd63ed27638222d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:39.636094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.636736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.638669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1033/2045] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:39 2022] DELETE /identity/v3/projects/e53d9fbfc82246fb9dd63ed27638222d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:39.642655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.644034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:39.677084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1013/2046] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:39.681523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ae390-3a3c-4df7-b371-e74f910c7d89 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.682933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-436ae390-3a3c-4df7-b371-e74f910c7d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:39.708700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52177eb-251f-42bc-a661-bcd951b0ca50 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.713451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.714364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.714653 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.714934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] PATH_INFO: `/v3/users/e8110372951948bca3169dcbdd90754e` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.716183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8110372951948bca3169dcbdd90754e)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.718139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.748436 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ae390-3a3c-4df7-b371-e74f910c7d89 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.753870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27033202-3da5-47d9-89fb-e4ef549b4c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.754655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27033202-3da5-47d9-89fb-e4ef549b4c40 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.754985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27033202-3da5-47d9-89fb-e4ef549b4c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.755324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27033202-3da5-47d9-89fb-e4ef549b4c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.756018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27033202-3da5-47d9-89fb-e4ef549b4c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.766658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27033202-3da5-47d9-89fb-e4ef549b4c40 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.772154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8110372951948bca3169dcbdd90754e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.788663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8110372951948bca3169dcbdd90754e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.796298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8110372951948bca3169dcbdd90754e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.797135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8110372951948bca3169dcbdd90754e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.797802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8110372951948bca3169dcbdd90754e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:39.802817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1014/2047] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:39 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:39.806546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27033202-3da5-47d9-89fb-e4ef549b4c40 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.808368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-27033202-3da5-47d9-89fb-e4ef549b4c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:39.815978 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1034/2048] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:39 2022] DELETE /identity/v3/users/e8110372951948bca3169dcbdd90754e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:39.883100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27033202-3da5-47d9-89fb-e4ef549b4c40 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:39.949454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c3d89-35ce-4410-80ff-422640ca021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:39.950306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c3d89-35ce-4410-80ff-422640ca021d admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:39.950595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c3d89-35ce-4410-80ff-422640ca021d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:39.951332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c3d89-35ce-4410-80ff-422640ca021d admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:39.951576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c3d89-35ce-4410-80ff-422640ca021d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:39.953611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c3d89-35ce-4410-80ff-422640ca021d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:39.978401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1015/2049] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:39 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:39.982525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:39.995884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789cd9-e06b-4dbc-b47a-f15ba4fc08b4 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.000727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a49ae0-66a7-4e98-8bb3-368dd67d8634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.001478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a49ae0-66a7-4e98-8bb3-368dd67d8634 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.001835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a49ae0-66a7-4e98-8bb3-368dd67d8634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.002216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a49ae0-66a7-4e98-8bb3-368dd67d8634 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.003034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a49ae0-66a7-4e98-8bb3-368dd67d8634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.005214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a49ae0-66a7-4e98-8bb3-368dd67d8634 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.015479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1035/2050] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:40.019453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c3d89-35ce-4410-80ff-422640ca021d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.029936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c3d89-35ce-4410-80ff-422640ca021d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.034876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051f0e5-b5fb-46d5-9696-88a8f6ecf3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.035947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051f0e5-b5fb-46d5-9696-88a8f6ecf3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.036214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051f0e5-b5fb-46d5-9696-88a8f6ecf3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.036497 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051f0e5-b5fb-46d5-9696-88a8f6ecf3ba admin admin] PATH_INFO: `/v3/projects/27f64f861a5b4a8d9f012bc04dbf8745/users/1ad342ea36bd4607aac5018ce0a549b4/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.054046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051f0e5-b5fb-46d5-9696-88a8f6ecf3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f64f861a5b4a8d9f012bc04dbf8745, user_id=1ad342ea36bd4607aac5018ce0a549b4, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.056685 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051f0e5-b5fb-46d5-9696-88a8f6ecf3ba admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.071279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1016/2051] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:40 2022] PUT /identity/v3/projects/27f64f861a5b4a8d9f012bc04dbf8745/users/1ad342ea36bd4607aac5018ce0a549b4/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:40.075331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a49ae0-66a7-4e98-8bb3-368dd67d8634 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.085650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a49ae0-66a7-4e98-8bb3-368dd67d8634 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.143743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e103d8-4505-4341-9c8d-454ed414cecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.144450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e103d8-4505-4341-9c8d-454ed414cecf admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.144742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e103d8-4505-4341-9c8d-454ed414cecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.145024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e103d8-4505-4341-9c8d-454ed414cecf admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.145777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e103d8-4505-4341-9c8d-454ed414cecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.147487 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e103d8-4505-4341-9c8d-454ed414cecf admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.163576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1036/2052] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:40.163668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051f0e5-b5fb-46d5-9696-88a8f6ecf3ba admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.164362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e103d8-4505-4341-9c8d-454ed414cecf admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.164858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d051f0e5-b5fb-46d5-9696-88a8f6ecf3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:40.175907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e103d8-4505-4341-9c8d-454ed414cecf admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.179092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051f0e5-b5fb-46d5-9696-88a8f6ecf3ba admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.181375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17812cd-a27b-4962-8b40-995827ca7b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.182647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17812cd-a27b-4962-8b40-995827ca7b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.183014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17812cd-a27b-4962-8b40-995827ca7b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.183299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17812cd-a27b-4962-8b40-995827ca7b5b admin admin] PATH_INFO: `/v3/projects/27f64f861a5b4a8d9f012bc04dbf8745/users/1ad342ea36bd4607aac5018ce0a549b4/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.184268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.185245 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.185362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17812cd-a27b-4962-8b40-995827ca7b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f64f861a5b4a8d9f012bc04dbf8745, user_id=1ad342ea36bd4607aac5018ce0a549b4, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.185747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.186096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] PATH_INFO: `/v3/projects/a1e472192cea493398e2341086cf3e63` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.187486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e472192cea493398e2341086cf3e63)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.187971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17812cd-a27b-4962-8b40-995827ca7b5b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.189694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.199940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1037/2053] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:40 2022] PUT /identity/v3/projects/27f64f861a5b4a8d9f012bc04dbf8745/users/1ad342ea36bd4607aac5018ce0a549b4/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:40.211568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb94d3-82bc-4a11-ba6d-9c46dd36f8bc None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.211958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb94d3-82bc-4a11-ba6d-9c46dd36f8bc None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.212248 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb94d3-82bc-4a11-ba6d-9c46dd36f8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.237996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e472192cea493398e2341086cf3e63', 'request_id': 'req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:40.238812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-30fb94d3-82bc-4a11-ba6d-9c46dd36f8bc None None] MFA Rules not processed for user `1ad342ea36bd4607aac5018ce0a549b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:40.240097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-30fb94d3-82bc-4a11-ba6d-9c46dd36f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:40.244164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e472192cea493398e2341086cf3e63', 'request_id': 'req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:40.251538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e472192cea493398e2341086cf3e63', 'request_id': 'req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:40.262773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] The token cache is being invalidate because project a1e472192cea493398e2341086cf3e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:40.263116 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:40.263773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-b40da853-1eb7-435e-8f66-4cfbbcdcb6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:40.265320 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1017/2054] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:40 2022] DELETE /identity/v3/projects/a1e472192cea493398e2341086cf3e63 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:40.271062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135ca2b-9b04-4fa3-b1e0-b7032998d6e3 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.271353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135ca2b-9b04-4fa3-b1e0-b7032998d6e3 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.271634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135ca2b-9b04-4fa3-b1e0-b7032998d6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.290334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-0135ca2b-9b04-4fa3-b1e0-b7032998d6e3 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:40.291543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0135ca2b-9b04-4fa3-b1e0-b7032998d6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:40.308008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1038/2055] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:40.322792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb94d3-82bc-4a11-ba6d-9c46dd36f8bc None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.324233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-30fb94d3-82bc-4a11-ba6d-9c46dd36f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:40.367708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1018/2056] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:40.376034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11430d-f79c-488a-8938-a1dbd4df0c6d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.376339 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11430d-f79c-488a-8938-a1dbd4df0c6d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.377133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11430d-f79c-488a-8938-a1dbd4df0c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.392104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb94d3-82bc-4a11-ba6d-9c46dd36f8bc None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.395987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dee81-49a0-4a62-93c4-c2de2d771223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.396641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dee81-49a0-4a62-93c4-c2de2d771223 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.396923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dee81-49a0-4a62-93c4-c2de2d771223 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.397199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dee81-49a0-4a62-93c4-c2de2d771223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.402454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2e11430d-f79c-488a-8938-a1dbd4df0c6d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:40.406044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2e11430d-f79c-488a-8938-a1dbd4df0c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:40.407377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dee81-49a0-4a62-93c4-c2de2d771223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.409317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dee81-49a0-4a62-93c4-c2de2d771223 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.420293 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1039/2057] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:40.421709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1019/2058] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:40.425748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11430d-f79c-488a-8938-a1dbd4df0c6d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.436710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11430d-f79c-488a-8938-a1dbd4df0c6d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.442011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e7ad4-04c4-4fc4-96e5-c8b2aee7be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.442796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e7ad4-04c4-4fc4-96e5-c8b2aee7be09 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.443083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e7ad4-04c4-4fc4-96e5-c8b2aee7be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.443354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e7ad4-04c4-4fc4-96e5-c8b2aee7be09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.444084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e7ad4-04c4-4fc4-96e5-c8b2aee7be09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:40.444392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e7ad4-04c4-4fc4-96e5-c8b2aee7be09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.445996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e7ad4-04c4-4fc4-96e5-c8b2aee7be09 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.464065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1020/2059] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:25:40.465674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dee81-49a0-4a62-93c4-c2de2d771223 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.479270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dee81-49a0-4a62-93c4-c2de2d771223 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.484520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718fb2c-2f07-4b2f-94ee-2dcede72c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.485387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718fb2c-2f07-4b2f-94ee-2dcede72c163 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.485855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718fb2c-2f07-4b2f-94ee-2dcede72c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.486381 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718fb2c-2f07-4b2f-94ee-2dcede72c163 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.487250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718fb2c-2f07-4b2f-94ee-2dcede72c163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.489952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718fb2c-2f07-4b2f-94ee-2dcede72c163 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.518289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1040/2060] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:40 2022] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:40.523194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e7ad4-04c4-4fc4-96e5-c8b2aee7be09 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.533806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e7ad4-04c4-4fc4-96e5-c8b2aee7be09 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.594194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e795-82b8-41f5-a01a-34882ea97c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.595029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e795-82b8-41f5-a01a-34882ea97c5c admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.595125 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e795-82b8-41f5-a01a-34882ea97c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.595401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e795-82b8-41f5-a01a-34882ea97c5c admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.596064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4e795-82b8-41f5-a01a-34882ea97c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.597954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4e795-82b8-41f5-a01a-34882ea97c5c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.622135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1021/2061] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:40 2022] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:40.624583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718fb2c-2f07-4b2f-94ee-2dcede72c163 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.634647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718fb2c-2f07-4b2f-94ee-2dcede72c163 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.639247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fc4c2-3baa-450b-8260-8c79af039ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.639906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fc4c2-3baa-450b-8260-8c79af039ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.640191 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fc4c2-3baa-450b-8260-8c79af039ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.640463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fc4c2-3baa-450b-8260-8c79af039ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.641219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fc4c2-3baa-450b-8260-8c79af039ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.642848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fc4c2-3baa-450b-8260-8c79af039ed7 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.654321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1041/2062] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:40.658460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e795-82b8-41f5-a01a-34882ea97c5c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.673713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e795-82b8-41f5-a01a-34882ea97c5c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.678467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b84c9-796e-41d3-967c-23cf8ce54f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.679134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b84c9-796e-41d3-967c-23cf8ce54f47 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.679421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b84c9-796e-41d3-967c-23cf8ce54f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.679702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b84c9-796e-41d3-967c-23cf8ce54f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.680426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b84c9-796e-41d3-967c-23cf8ce54f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.682030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b84c9-796e-41d3-967c-23cf8ce54f47 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.694020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1022/2063] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:40.696321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fc4c2-3baa-450b-8260-8c79af039ed7 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.706183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fc4c2-3baa-450b-8260-8c79af039ed7 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.711352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523694-c460-44b2-8b28-debb8065e3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.712353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523694-c460-44b2-8b28-debb8065e3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.712641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523694-c460-44b2-8b28-debb8065e3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.712949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523694-c460-44b2-8b28-debb8065e3fa admin admin] PATH_INFO: `/v3/projects/4ba60df22e1f45678a23999f82959953/users/f003033954cd43479210cd88e0a95cfb/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.728315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5523694-c460-44b2-8b28-debb8065e3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba60df22e1f45678a23999f82959953, user_id=f003033954cd43479210cd88e0a95cfb, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.731148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5523694-c460-44b2-8b28-debb8065e3fa admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.745673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1042/2064] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:40 2022] PUT /identity/v3/projects/4ba60df22e1f45678a23999f82959953/users/f003033954cd43479210cd88e0a95cfb/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:40.758129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba045-0372-4a95-8782-c2a99f11074a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.758436 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba045-0372-4a95-8782-c2a99f11074a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.758715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba045-0372-4a95-8782-c2a99f11074a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.788480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b84ba045-0372-4a95-8782-c2a99f11074a None None] MFA Rules not processed for user `f003033954cd43479210cd88e0a95cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:40.789689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b84ba045-0372-4a95-8782-c2a99f11074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:40.867148 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1023/2065] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:40.896012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523694-c460-44b2-8b28-debb8065e3fa admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.897725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a5523694-c460-44b2-8b28-debb8065e3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:40.956402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523694-c460-44b2-8b28-debb8065e3fa admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:40.961634 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5451a-c996-4eeb-b2d0-3d748971f45b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:40.962326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5451a-c996-4eeb-b2d0-3d748971f45b service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:40.962635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5451a-c996-4eeb-b2d0-3d748971f45b service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:40.962878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5451a-c996-4eeb-b2d0-3d748971f45b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:40.966360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ba045-0372-4a95-8782-c2a99f11074a None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:40.967854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b84ba045-0372-4a95-8782-c2a99f11074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:40.971764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5451a-c996-4eeb-b2d0-3d748971f45b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:40.973271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5451a-c996-4eeb-b2d0-3d748971f45b service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:40.983014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1043/2066] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:40.998387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5451a-c996-4eeb-b2d0-3d748971f45b service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:41.034910 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ba045-0372-4a95-8782-c2a99f11074a None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:41.040311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:41.042244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:41.042360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:41.042638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] PATH_INFO: `/v3/users/6379a561767a4590a15cb26339a7b885` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:41.043853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6379a561767a4590a15cb26339a7b885)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:41.045803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:41.065404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5451a-c996-4eeb-b2d0-3d748971f45b service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:41.070484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:41.071428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:41.071635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:41.071900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] PATH_INFO: `/v3/users/f003033954cd43479210cd88e0a95cfb` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:41.073131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f003033954cd43479210cd88e0a95cfb)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:41.075523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:41.098009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6379a561767a4590a15cb26339a7b885'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.106470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6379a561767a4590a15cb26339a7b885'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.107241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6379a561767a4590a15cb26339a7b885'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.116084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6379a561767a4590a15cb26339a7b885'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.128753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8c85cd81-9b4e-4a23-913b-4ec9ca6a9efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6379a561767a4590a15cb26339a7b885'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.128902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f003033954cd43479210cd88e0a95cfb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.134977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1024/2067] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:40 2022] DELETE /identity/v3/users/6379a561767a4590a15cb26339a7b885 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:41.138591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f003033954cd43479210cd88e0a95cfb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.139273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b87b4c-cff7-40ba-a0e9-7c5df742fb72 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:41.139579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b87b4c-cff7-40ba-a0e9-7c5df742fb72 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:41.139930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b87b4c-cff7-40ba-a0e9-7c5df742fb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:41.146497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f003033954cd43479210cd88e0a95cfb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.147193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f003033954cd43479210cd88e0a95cfb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.147816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-11ca3237-f43c-4e4c-b2cd-ae1efca6546a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f003033954cd43479210cd88e0a95cfb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:41.157411 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-52b87b4c-cff7-40ba-a0e9-7c5df742fb72 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:41.158889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-52b87b4c-cff7-40ba-a0e9-7c5df742fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:41.165557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1044/2068] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:40 2022] DELETE /identity/v3/users/f003033954cd43479210cd88e0a95cfb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:41.169940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c4f75-1924-43a1-b85e-1cabe2ae83dc None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:41.170269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c4f75-1924-43a1-b85e-1cabe2ae83dc None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:41.170553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c4f75-1924-43a1-b85e-1cabe2ae83dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:41.187675 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-070c4f75-1924-43a1-b85e-1cabe2ae83dc None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:41.188898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-070c4f75-1924-43a1-b85e-1cabe2ae83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:41.216782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1025/2069] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:41.226713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b87b4c-cff7-40ba-a0e9-7c5df742fb72 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:41.228228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-52b87b4c-cff7-40ba-a0e9-7c5df742fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:41.250971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1045/2070] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:41.260724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c4f75-1924-43a1-b85e-1cabe2ae83dc None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:41.262519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-070c4f75-1924-43a1-b85e-1cabe2ae83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:41.286192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b87b4c-cff7-40ba-a0e9-7c5df742fb72 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:41.324888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c4f75-1924-43a1-b85e-1cabe2ae83dc None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:41.328538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92157344-b86b-45a8-a21d-a6d3f44d80ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:41.329184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92157344-b86b-45a8-a21d-a6d3f44d80ba service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:41.329466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92157344-b86b-45a8-a21d-a6d3f44d80ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:41.329744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92157344-b86b-45a8-a21d-a6d3f44d80ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:41.339219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92157344-b86b-45a8-a21d-a6d3f44d80ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:41.340637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92157344-b86b-45a8-a21d-a6d3f44d80ba service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:41.341450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877d324-e90b-4b88-bbf4-265d51f79cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:41.342099 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877d324-e90b-4b88-bbf4-265d51f79cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:41.342407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877d324-e90b-4b88-bbf4-265d51f79cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:41.342683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877d324-e90b-4b88-bbf4-265d51f79cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:41.350882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1046/2071] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:41.352313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877d324-e90b-4b88-bbf4-265d51f79cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:41.353749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877d324-e90b-4b88-bbf4-265d51f79cc8 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:41.363363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1026/2072] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:42.008701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92157344-b86b-45a8-a21d-a6d3f44d80ba service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.010715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-92157344-b86b-45a8-a21d-a6d3f44d80ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.015052 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877d324-e90b-4b88-bbf4-265d51f79cc8 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.016407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a877d324-e90b-4b88-bbf4-265d51f79cc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.031030 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877d324-e90b-4b88-bbf4-265d51f79cc8 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.044787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92157344-b86b-45a8-a21d-a6d3f44d80ba service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.047430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.048903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.049715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.050484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] PATH_INFO: `/v3/projects/4ba60df22e1f45678a23999f82959953` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.052702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba60df22e1f45678a23999f82959953)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.055585 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.056722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.057092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.059447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.059952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] PATH_INFO: `/v3/projects/24f3f0674bdc45309c26ebc4d6fa1e23` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.064907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f3f0674bdc45309c26ebc4d6fa1e23)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.067212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.117484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba60df22e1f45678a23999f82959953', 'request_id': 'req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.123487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba60df22e1f45678a23999f82959953', 'request_id': 'req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.127507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f3f0674bdc45309c26ebc4d6fa1e23', 'request_id': 'req-285a68dc-8bc2-4029-99dc-8ede87e59a1d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.133730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba60df22e1f45678a23999f82959953', 'request_id': 'req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.138469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f3f0674bdc45309c26ebc4d6fa1e23', 'request_id': 'req-285a68dc-8bc2-4029-99dc-8ede87e59a1d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.146725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f3f0674bdc45309c26ebc4d6fa1e23', 'request_id': 'req-285a68dc-8bc2-4029-99dc-8ede87e59a1d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.147761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] The token cache is being invalidate because project 4ba60df22e1f45678a23999f82959953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:42.148109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.148773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4b0dbc8f-a5e8-487d-8366-e594f49fbb17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.151771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1027/2073] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:42 2022] DELETE /identity/v3/projects/4ba60df22e1f45678a23999f82959953 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:42.156734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8cebc-a97d-4288-ba41-105acd0206b0 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.157034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8cebc-a97d-4288-ba41-105acd0206b0 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.157849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8cebc-a97d-4288-ba41-105acd0206b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.159962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] The token cache is being invalidate because project 24f3f0674bdc45309c26ebc4d6fa1e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:42.160436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.162613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.164519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1047/2074] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:42 2022] DELETE /identity/v3/projects/24f3f0674bdc45309c26ebc4d6fa1e23 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:42.168214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.169557 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.178840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-9cd8cebc-a97d-4288-ba41-105acd0206b0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:42.180095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9cd8cebc-a97d-4288-ba41-105acd0206b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.241690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a68dc-8bc2-4029-99dc-8ede87e59a1d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.243443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1028/2075] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:42.246317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.247184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.247470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.247747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] PATH_INFO: `/v3/users/1ad342ea36bd4607aac5018ce0a549b4` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.248983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad342ea36bd4607aac5018ce0a549b4)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.250917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.251046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d6709-fcba-4b2f-82aa-a54dc61fbf9c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.251295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d6709-fcba-4b2f-82aa-a54dc61fbf9c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.254275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d6709-fcba-4b2f-82aa-a54dc61fbf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.273471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3d5d6709-fcba-4b2f-82aa-a54dc61fbf9c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:42.274707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3d5d6709-fcba-4b2f-82aa-a54dc61fbf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.284751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1029/2076] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:42.289205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d6709-fcba-4b2f-82aa-a54dc61fbf9c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.298302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d6709-fcba-4b2f-82aa-a54dc61fbf9c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.303016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed80b-dbb9-4001-b21b-9a703cf8ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.303680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed80b-dbb9-4001-b21b-9a703cf8ae1b admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.303970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed80b-dbb9-4001-b21b-9a703cf8ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.304317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed80b-dbb9-4001-b21b-9a703cf8ae1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.304945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed80b-dbb9-4001-b21b-9a703cf8ae1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:42.305131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad342ea36bd4607aac5018ce0a549b4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.305234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed80b-dbb9-4001-b21b-9a703cf8ae1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.306932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed80b-dbb9-4001-b21b-9a703cf8ae1b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.312404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad342ea36bd4607aac5018ce0a549b4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.319003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1030/2077] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:25:42.323376 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed80b-dbb9-4001-b21b-9a703cf8ae1b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.323550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad342ea36bd4607aac5018ce0a549b4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.324173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad342ea36bd4607aac5018ce0a549b4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.325055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad342ea36bd4607aac5018ce0a549b4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.333415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed80b-dbb9-4001-b21b-9a703cf8ae1b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.338082 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6c8d4-591f-411b-953d-be410c096595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.338765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6c8d4-591f-411b-953d-be410c096595 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.339053 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6c8d4-591f-411b-953d-be410c096595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.339332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6c8d4-591f-411b-953d-be410c096595 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.340014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6c8d4-591f-411b-953d-be410c096595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.341901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6c8d4-591f-411b-953d-be410c096595 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.345284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1048/2078] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:42 2022] DELETE /identity/v3/users/1ad342ea36bd4607aac5018ce0a549b4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:42.367627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1031/2079] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:42 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:42.371738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.373133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.439177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbf128-20ae-4ed7-be41-5c134a432535 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.501477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef511b-17ae-4a53-af1f-ed1d76b3f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.502359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef511b-17ae-4a53-af1f-ed1d76b3f0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.502633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef511b-17ae-4a53-af1f-ed1d76b3f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.502914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef511b-17ae-4a53-af1f-ed1d76b3f0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.503553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef511b-17ae-4a53-af1f-ed1d76b3f0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.505798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef511b-17ae-4a53-af1f-ed1d76b3f0c9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.529150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1049/2080] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:42 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:42.533639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6c8d4-591f-411b-953d-be410c096595 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.548221 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6c8d4-591f-411b-953d-be410c096595 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.553497 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351d41-aebb-49d5-9b93-95375ed99ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.554203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351d41-aebb-49d5-9b93-95375ed99ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.554487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351d41-aebb-49d5-9b93-95375ed99ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.554760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351d41-aebb-49d5-9b93-95375ed99ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.555493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a351d41-aebb-49d5-9b93-95375ed99ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.557117 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a351d41-aebb-49d5-9b93-95375ed99ffc admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.567051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1032/2081] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:42.571735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef511b-17ae-4a53-af1f-ed1d76b3f0c9 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.582015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef511b-17ae-4a53-af1f-ed1d76b3f0c9 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.587291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5346e4-f81f-4728-96e4-b4953f6d7a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.587960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5346e4-f81f-4728-96e4-b4953f6d7a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.588241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5346e4-f81f-4728-96e4-b4953f6d7a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.588531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5346e4-f81f-4728-96e4-b4953f6d7a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.589388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5346e4-f81f-4728-96e4-b4953f6d7a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.590992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5346e4-f81f-4728-96e4-b4953f6d7a76 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.601571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1050/2082] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:42.605452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351d41-aebb-49d5-9b93-95375ed99ffc admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.616017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351d41-aebb-49d5-9b93-95375ed99ffc admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.620498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5346e4-f81f-4728-96e4-b4953f6d7a76 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.621370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8de82-b23d-4454-bc50-af6fb80a5b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.622326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8de82-b23d-4454-bc50-af6fb80a5b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.622433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fb5346e4-f81f-4728-96e4-b4953f6d7a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.622610 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8de82-b23d-4454-bc50-af6fb80a5b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.622884 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8de82-b23d-4454-bc50-af6fb80a5b38 admin admin] PATH_INFO: `/v3/projects/095778b99861451386b16276ef535102/users/f68f176c9da041b2a99fea41971c81a0/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.636865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5346e4-f81f-4728-96e4-b4953f6d7a76 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.641650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.643074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.643370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.643783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] PATH_INFO: `/v3/projects/27f64f861a5b4a8d9f012bc04dbf8745` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.645810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f64f861a5b4a8d9f012bc04dbf8745)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.648363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.649498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8de82-b23d-4454-bc50-af6fb80a5b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095778b99861451386b16276ef535102, user_id=f68f176c9da041b2a99fea41971c81a0, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.652244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8de82-b23d-4454-bc50-af6fb80a5b38 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.665792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1033/2083] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:42 2022] PUT /identity/v3/projects/095778b99861451386b16276ef535102/users/f68f176c9da041b2a99fea41971c81a0/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:42.676025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f94b19-a98b-4a61-a465-5f3a05c895de None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.676348 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f94b19-a98b-4a61-a465-5f3a05c895de None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.677164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f94b19-a98b-4a61-a465-5f3a05c895de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.697284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f64f861a5b4a8d9f012bc04dbf8745', 'request_id': 'req-6017237d-38d9-47a5-84ba-a2db07d609e3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.703850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-f6f94b19-a98b-4a61-a465-5f3a05c895de None None] MFA Rules not processed for user `f68f176c9da041b2a99fea41971c81a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:42.705061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f6f94b19-a98b-4a61-a465-5f3a05c895de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.707532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f64f861a5b4a8d9f012bc04dbf8745', 'request_id': 'req-6017237d-38d9-47a5-84ba-a2db07d609e3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.716732 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f64f861a5b4a8d9f012bc04dbf8745', 'request_id': 'req-6017237d-38d9-47a5-84ba-a2db07d609e3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.728088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] The token cache is being invalidate because project 27f64f861a5b4a8d9f012bc04dbf8745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:42.728381 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.729423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6017237d-38d9-47a5-84ba-a2db07d609e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:42.736981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1051/2084] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:42 2022] DELETE /identity/v3/projects/27f64f861a5b4a8d9f012bc04dbf8745 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:42.739745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5f800-58f2-4392-9e83-f25fb8434793 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.740119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5f800-58f2-4392-9e83-f25fb8434793 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.740473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5f800-58f2-4392-9e83-f25fb8434793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.759344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-40b5f800-58f2-4392-9e83-f25fb8434793 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:42.760591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-40b5f800-58f2-4392-9e83-f25fb8434793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.779889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1034/2085] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:42.796061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f94b19-a98b-4a61-a465-5f3a05c895de None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.797899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f6f94b19-a98b-4a61-a465-5f3a05c895de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.835124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1052/2086] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:42.843200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c77e8-58a2-4557-9ad4-c36f8f15063c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.843497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c77e8-58a2-4557-9ad4-c36f8f15063c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.843784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c77e8-58a2-4557-9ad4-c36f8f15063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.854468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f94b19-a98b-4a61-a465-5f3a05c895de None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.858333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6508a56-9ba3-4204-9ef3-29c90f3f12d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.858986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508a56-9ba3-4204-9ef3-29c90f3f12d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.859273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508a56-9ba3-4204-9ef3-29c90f3f12d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.859553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508a56-9ba3-4204-9ef3-29c90f3f12d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.863808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-3a8c77e8-58a2-4557-9ad4-c36f8f15063c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:42.865564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3a8c77e8-58a2-4557-9ad4-c36f8f15063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:42.869292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6508a56-9ba3-4204-9ef3-29c90f3f12d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.871268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6508a56-9ba3-4204-9ef3-29c90f3f12d5 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.874151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1053/2087] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:42.881923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1035/2088] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:42.884806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c77e8-58a2-4557-9ad4-c36f8f15063c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.896057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c77e8-58a2-4557-9ad4-c36f8f15063c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.901998 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b9b7-52d2-4092-bc15-9b67b43dfc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.902696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b9b7-52d2-4092-bc15-9b67b43dfc33 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.902979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b9b7-52d2-4092-bc15-9b67b43dfc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.903250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b9b7-52d2-4092-bc15-9b67b43dfc33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.903970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88b9b7-52d2-4092-bc15-9b67b43dfc33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:42.904274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88b9b7-52d2-4092-bc15-9b67b43dfc33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.905874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88b9b7-52d2-4092-bc15-9b67b43dfc33 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.922222 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1054/2089] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:25:42.923700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6508a56-9ba3-4204-9ef3-29c90f3f12d5 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.934730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6508a56-9ba3-4204-9ef3-29c90f3f12d5 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:42.944439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cdad3-a157-49d0-b13b-0b8748b8e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:42.945396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cdad3-a157-49d0-b13b-0b8748b8e988 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:42.945768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cdad3-a157-49d0-b13b-0b8748b8e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:42.945943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cdad3-a157-49d0-b13b-0b8748b8e988 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:42.946646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cdad3-a157-49d0-b13b-0b8748b8e988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:42.948578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cdad3-a157-49d0-b13b-0b8748b8e988 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:42.974604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1036/2090] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:42 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:42.978712 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b9b7-52d2-4092-bc15-9b67b43dfc33 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:42.988424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b9b7-52d2-4092-bc15-9b67b43dfc33 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:43.046033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e665a-9469-4904-87a2-120454942a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:43.046761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e665a-9469-4904-87a2-120454942a89 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:43.047047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e665a-9469-4904-87a2-120454942a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:43.047331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e665a-9469-4904-87a2-120454942a89 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:43.048103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e665a-9469-4904-87a2-120454942a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:43.050209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e665a-9469-4904-87a2-120454942a89 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:43.069698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1055/2091] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:42 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:43.073837 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cdad3-a157-49d0-b13b-0b8748b8e988 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:43.085034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cdad3-a157-49d0-b13b-0b8748b8e988 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:43.091372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7c779-3f5f-4735-9516-2dc0c4cd8f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:43.092068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7c779-3f5f-4735-9516-2dc0c4cd8f5d admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:43.092356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7c779-3f5f-4735-9516-2dc0c4cd8f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:43.092634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7c779-3f5f-4735-9516-2dc0c4cd8f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:43.093360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7c779-3f5f-4735-9516-2dc0c4cd8f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:43.094988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7c779-3f5f-4735-9516-2dc0c4cd8f5d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:43.106153 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1037/2092] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:43.110182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e665a-9469-4904-87a2-120454942a89 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:43.125891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e665a-9469-4904-87a2-120454942a89 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:43.125891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167edf7-fec6-4f33-9531-5f690b4d31fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:43.125891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167edf7-fec6-4f33-9531-5f690b4d31fe admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:43.126719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167edf7-fec6-4f33-9531-5f690b4d31fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:43.126719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167edf7-fec6-4f33-9531-5f690b4d31fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:43.127187 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167edf7-fec6-4f33-9531-5f690b4d31fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:43.128797 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167edf7-fec6-4f33-9531-5f690b4d31fe admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:43.140096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1056/2093] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:43.144111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7c779-3f5f-4735-9516-2dc0c4cd8f5d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:43.156595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7c779-3f5f-4735-9516-2dc0c4cd8f5d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:43.161829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c18444-5c86-473e-9660-43ce80edfefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:43.162769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c18444-5c86-473e-9660-43ce80edfefd admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:43.163156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c18444-5c86-473e-9660-43ce80edfefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:43.163315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c18444-5c86-473e-9660-43ce80edfefd admin admin] PATH_INFO: `/v3/projects/788735d9fc2b4767b361bcc431fa4542/users/6d165ef4da394bac8cfa332f49571467/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:43.180788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c18444-5c86-473e-9660-43ce80edfefd admin admin] RBAC: Authorizing `identity:create_grant(project_id=788735d9fc2b4767b361bcc431fa4542, user_id=6d165ef4da394bac8cfa332f49571467, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:43.183510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c18444-5c86-473e-9660-43ce80edfefd admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:43.197760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1038/2094] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:43 2022] PUT /identity/v3/projects/788735d9fc2b4767b361bcc431fa4542/users/6d165ef4da394bac8cfa332f49571467/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:43.202746 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3c8b-6782-479a-92b2-1f8242f83674 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:43.203042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3c8b-6782-479a-92b2-1f8242f83674 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:43.203322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3c8b-6782-479a-92b2-1f8242f83674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:43.221493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f51e3c8b-6782-479a-92b2-1f8242f83674 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:43.222734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f51e3c8b-6782-479a-92b2-1f8242f83674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:43.296773 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1057/2095] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:43.306609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c18444-5c86-473e-9660-43ce80edfefd admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:43.308363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-67c18444-5c86-473e-9660-43ce80edfefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:43.362683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c18444-5c86-473e-9660-43ce80edfefd admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:43.366371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b6790-e3a7-40ed-a24a-929bd5113d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:43.367008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b6790-e3a7-40ed-a24a-929bd5113d2d service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:43.367292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b6790-e3a7-40ed-a24a-929bd5113d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:43.367576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b6790-e3a7-40ed-a24a-929bd5113d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:43.376292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b6790-e3a7-40ed-a24a-929bd5113d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:43.377709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b6790-e3a7-40ed-a24a-929bd5113d2d service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:43.386945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1039/2096] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:44.377519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ca48d-4273-4eb7-b173-6e114ebf0097 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:44.378032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ca48d-4273-4eb7-b173-6e114ebf0097 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:44.378292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ca48d-4273-4eb7-b173-6e114ebf0097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:44.397649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-b81ca48d-4273-4eb7-b173-6e114ebf0097 None None] MFA Rules not processed for user `b12e82c478d84f30b9e8eaec84531869`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:44.399050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b81ca48d-4273-4eb7-b173-6e114ebf0097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:44.470961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1058/2097] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:47.088010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b6790-e3a7-40ed-a24a-929bd5113d2d service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:47.091773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7a6b6790-e3a7-40ed-a24a-929bd5113d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:47.107545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b6790-e3a7-40ed-a24a-929bd5113d2d service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:47.123251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:47.124241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:47.124605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:47.124990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] PATH_INFO: `/v3/users/8d6a363d7a5749e3af4f07761395d159` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:47.126319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6a363d7a5749e3af4f07761395d159)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:47.128637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:47.188213 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6a363d7a5749e3af4f07761395d159'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:47.195841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6a363d7a5749e3af4f07761395d159'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:47.197018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6a363d7a5749e3af4f07761395d159'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:47.204886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6a363d7a5749e3af4f07761395d159'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:47.219914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6a363d7a5749e3af4f07761395d159'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:47.227351 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1040/2098] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:47 2022] DELETE /identity/v3/users/8d6a363d7a5749e3af4f07761395d159 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:47.231622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98baf3-696a-4427-b103-4be9df455a7a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:47.232558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98baf3-696a-4427-b103-4be9df455a7a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:47.233091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98baf3-696a-4427-b103-4be9df455a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:47.252762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9c98baf3-696a-4427-b103-4be9df455a7a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:47.254068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9c98baf3-696a-4427-b103-4be9df455a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:47.332306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1059/2099] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:47.343070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:47.345580 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:47.418094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe039f86-2fbd-48fb-97ed-e18a54e67a90 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:47.422840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1769aa4-f95e-44da-8f25-dd4475054def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:47.423728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1769aa4-f95e-44da-8f25-dd4475054def service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:47.424086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1769aa4-f95e-44da-8f25-dd4475054def service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:47.425642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1769aa4-f95e-44da-8f25-dd4475054def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:47.436277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1769aa4-f95e-44da-8f25-dd4475054def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:47.438101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1769aa4-f95e-44da-8f25-dd4475054def service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:47.449940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1041/2100] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:47.829850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98baf3-696a-4427-b103-4be9df455a7a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:47.831527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9c98baf3-696a-4427-b103-4be9df455a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:47.855173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98baf3-696a-4427-b103-4be9df455a7a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:47.880067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:47.881845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:47.882796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:47.884094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] PATH_INFO: `/v3/projects/d5fefe4c756c4befacd17ba722e29064` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:47.886977 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5fefe4c756c4befacd17ba722e29064)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:47.889091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:47.986093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5fefe4c756c4befacd17ba722e29064', 'request_id': 'req-840bbe83-8959-4409-be58-d16a179899a1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:48.003615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5fefe4c756c4befacd17ba722e29064', 'request_id': 'req-840bbe83-8959-4409-be58-d16a179899a1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:48.042666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5fefe4c756c4befacd17ba722e29064', 'request_id': 'req-840bbe83-8959-4409-be58-d16a179899a1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:48.061579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] The token cache is being invalidate because project d5fefe4c756c4befacd17ba722e29064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:48.061874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:48.063919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-840bbe83-8959-4409-be58-d16a179899a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:48.068515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1060/2101] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:47 2022] DELETE /identity/v3/projects/d5fefe4c756c4befacd17ba722e29064 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:48.078517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca191ae0-dcdb-40f9-82f1-057facba4e5b None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.078839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca191ae0-dcdb-40f9-82f1-057facba4e5b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.079082 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca191ae0-dcdb-40f9-82f1-057facba4e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.110942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ca191ae0-dcdb-40f9-82f1-057facba4e5b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:48.112720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ca191ae0-dcdb-40f9-82f1-057facba4e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:48.196373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1042/2102] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:48.200756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c0cd-9d86-4deb-9ae2-0fc3639d8e7b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.201044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c0cd-9d86-4deb-9ae2-0fc3639d8e7b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.201318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c0cd-9d86-4deb-9ae2-0fc3639d8e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.225799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d5d3c0cd-9d86-4deb-9ae2-0fc3639d8e7b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:48.228507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d5d3c0cd-9d86-4deb-9ae2-0fc3639d8e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:48.242980 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1061/2103] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:48.244416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca191ae0-dcdb-40f9-82f1-057facba4e5b None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:48.256783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca191ae0-dcdb-40f9-82f1-057facba4e5b None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:48.261794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1505-d3ac-405f-befc-c2aeae23600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:48.262570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1505-d3ac-405f-befc-c2aeae23600b admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.262945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1505-d3ac-405f-befc-c2aeae23600b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.263234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1505-d3ac-405f-befc-c2aeae23600b admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.263971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1505-d3ac-405f-befc-c2aeae23600b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:48.264331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1505-d3ac-405f-befc-c2aeae23600b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:48.265967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1505-d3ac-405f-befc-c2aeae23600b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:48.279499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1043/2104] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:25:48.284905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3c0cd-9d86-4deb-9ae2-0fc3639d8e7b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:48.295924 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3c0cd-9d86-4deb-9ae2-0fc3639d8e7b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:48.306975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aaaec-52e4-4edc-9716-3f7a5c066db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:48.307693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aaaec-52e4-4edc-9716-3f7a5c066db4 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.308006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aaaec-52e4-4edc-9716-3f7a5c066db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.308332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aaaec-52e4-4edc-9716-3f7a5c066db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.309112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aaaec-52e4-4edc-9716-3f7a5c066db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:48.311090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aaaec-52e4-4edc-9716-3f7a5c066db4 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:48.342821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1062/2105] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:48 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:48.347184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1505-d3ac-405f-befc-c2aeae23600b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:48.358318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1505-d3ac-405f-befc-c2aeae23600b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:48.424425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0681fef-9c96-468e-bdb0-572dcf4be9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:48.425475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0681fef-9c96-468e-bdb0-572dcf4be9cd admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.425757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0681fef-9c96-468e-bdb0-572dcf4be9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.427180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0681fef-9c96-468e-bdb0-572dcf4be9cd admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.427419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0681fef-9c96-468e-bdb0-572dcf4be9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:48.429272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0681fef-9c96-468e-bdb0-572dcf4be9cd admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:48.451897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1044/2106] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:48 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:48.456475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aaaec-52e4-4edc-9716-3f7a5c066db4 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:48.467060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aaaec-52e4-4edc-9716-3f7a5c066db4 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:48.472125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988789e-9853-4fdf-84c2-91b6f4a572f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:48.473699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988789e-9853-4fdf-84c2-91b6f4a572f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.474085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988789e-9853-4fdf-84c2-91b6f4a572f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.474525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988789e-9853-4fdf-84c2-91b6f4a572f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.475346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988789e-9853-4fdf-84c2-91b6f4a572f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:48.477084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988789e-9853-4fdf-84c2-91b6f4a572f1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:48.493995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0681fef-9c96-468e-bdb0-572dcf4be9cd admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:48.494757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1063/2107] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:48.516871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0681fef-9c96-468e-bdb0-572dcf4be9cd admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:48.523556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8d1e4-2ab2-4ced-ab1b-77c09c877d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:48.524250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8d1e4-2ab2-4ced-ab1b-77c09c877d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.524536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8d1e4-2ab2-4ced-ab1b-77c09c877d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.524819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8d1e4-2ab2-4ced-ab1b-77c09c877d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.525563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8d1e4-2ab2-4ced-ab1b-77c09c877d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:48.527256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8d1e4-2ab2-4ced-ab1b-77c09c877d4f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:48.542336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1045/2108] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:48.547118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988789e-9853-4fdf-84c2-91b6f4a572f1 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:48.558211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988789e-9853-4fdf-84c2-91b6f4a572f1 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:48.563780 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871d3e5-27c2-4f79-94e2-4d687b8feacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:48.564685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871d3e5-27c2-4f79-94e2-4d687b8feacd admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.564975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871d3e5-27c2-4f79-94e2-4d687b8feacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.565252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871d3e5-27c2-4f79-94e2-4d687b8feacd admin admin] PATH_INFO: `/v3/projects/00f6f84aa47249b6a24714845399b140/users/132023ed0201417e83192c61e543c4e5/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.596059 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871d3e5-27c2-4f79-94e2-4d687b8feacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f6f84aa47249b6a24714845399b140, user_id=132023ed0201417e83192c61e543c4e5, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:48.601668 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871d3e5-27c2-4f79-94e2-4d687b8feacd admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:48.633759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1064/2109] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:48 2022] PUT /identity/v3/projects/00f6f84aa47249b6a24714845399b140/users/132023ed0201417e83192c61e543c4e5/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:48.644516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821141a-3e2b-4fd6-9589-653c0cf41c21 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.645102 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821141a-3e2b-4fd6-9589-653c0cf41c21 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.645398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821141a-3e2b-4fd6-9589-653c0cf41c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.699208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e821141a-3e2b-4fd6-9589-653c0cf41c21 None None] MFA Rules not processed for user `132023ed0201417e83192c61e543c4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:48.701139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e821141a-3e2b-4fd6-9589-653c0cf41c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:48.825107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1046/2110] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:48.830074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871d3e5-27c2-4f79-94e2-4d687b8feacd admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:48.941035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871d3e5-27c2-4f79-94e2-4d687b8feacd admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:48.947209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b3af9-db0f-47fc-91e8-ab45837a48e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:48.958462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b3af9-db0f-47fc-91e8-ab45837a48e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:48.959046 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b3af9-db0f-47fc-91e8-ab45837a48e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:48.959630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b3af9-db0f-47fc-91e8-ab45837a48e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:48.962256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b3af9-db0f-47fc-91e8-ab45837a48e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:48.965413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b3af9-db0f-47fc-91e8-ab45837a48e1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.002873 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1065/2111] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:48 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:49.011317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821141a-3e2b-4fd6-9589-653c0cf41c21 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.024717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821141a-3e2b-4fd6-9589-653c0cf41c21 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.075857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca079a8-340b-4044-90e1-3fb583abe1d6 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.076158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca079a8-340b-4044-90e1-3fb583abe1d6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.076436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca079a8-340b-4044-90e1-3fb583abe1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.088851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41cf8e-fa36-4c63-aa6a-36f5c27b46da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.089548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41cf8e-fa36-4c63-aa6a-36f5c27b46da admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.089832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41cf8e-fa36-4c63-aa6a-36f5c27b46da admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.090141 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41cf8e-fa36-4c63-aa6a-36f5c27b46da admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.090871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41cf8e-fa36-4c63-aa6a-36f5c27b46da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.092791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41cf8e-fa36-4c63-aa6a-36f5c27b46da admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.104776 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-cca079a8-340b-4044-90e1-3fb583abe1d6 None None] MFA Rules not processed for user `6d165ef4da394bac8cfa332f49571467`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:49.105990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-cca079a8-340b-4044-90e1-3fb583abe1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:49.114431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1047/2112] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:49 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:49.118381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41cf8e-fa36-4c63-aa6a-36f5c27b46da admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.129531 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41cf8e-fa36-4c63-aa6a-36f5c27b46da admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.135633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935e467-1ed5-4d33-8112-113c9194f3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.136373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935e467-1ed5-4d33-8112-113c9194f3ae admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.136659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935e467-1ed5-4d33-8112-113c9194f3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.136930 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935e467-1ed5-4d33-8112-113c9194f3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.138675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935e467-1ed5-4d33-8112-113c9194f3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.140254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935e467-1ed5-4d33-8112-113c9194f3ae admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.154289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1048/2113] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:49.156703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935e467-1ed5-4d33-8112-113c9194f3ae admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.167111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935e467-1ed5-4d33-8112-113c9194f3ae admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.171751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de346005-1d61-4b4a-a138-721d8cd41182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.172630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346005-1d61-4b4a-a138-721d8cd41182 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.172913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346005-1d61-4b4a-a138-721d8cd41182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.173185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346005-1d61-4b4a-a138-721d8cd41182 admin admin] PATH_INFO: `/v3/projects/7f4a6f2c8ffd42fea7cb179fb57e7621/users/397c08957926488d879e8e6d535d2290/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.182005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1066/2114] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:49.186583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca079a8-340b-4044-90e1-3fb583abe1d6 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.187996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-cca079a8-340b-4044-90e1-3fb583abe1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:49.190285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de346005-1d61-4b4a-a138-721d8cd41182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4a6f2c8ffd42fea7cb179fb57e7621, user_id=397c08957926488d879e8e6d535d2290, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.193326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de346005-1d61-4b4a-a138-721d8cd41182 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.202310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca079a8-340b-4044-90e1-3fb583abe1d6 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.212003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1049/2115] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:49 2022] PUT /identity/v3/projects/7f4a6f2c8ffd42fea7cb179fb57e7621/users/397c08957926488d879e8e6d535d2290/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:49.213018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de346005-1d61-4b4a-a138-721d8cd41182 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.268017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051a3ba-f0ae-4184-922e-9f66db4b2a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.268788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051a3ba-f0ae-4184-922e-9f66db4b2a73 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.269148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051a3ba-f0ae-4184-922e-9f66db4b2a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.269493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051a3ba-f0ae-4184-922e-9f66db4b2a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.270507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051a3ba-f0ae-4184-922e-9f66db4b2a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.272626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051a3ba-f0ae-4184-922e-9f66db4b2a73 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.283183 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de346005-1d61-4b4a-a138-721d8cd41182 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.297496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd6ad9-39a1-4a88-8e0d-6f9f706868a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.298264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd6ad9-39a1-4a88-8e0d-6f9f706868a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.298516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd6ad9-39a1-4a88-8e0d-6f9f706868a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.298844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd6ad9-39a1-4a88-8e0d-6f9f706868a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.299695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd6ad9-39a1-4a88-8e0d-6f9f706868a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.301390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd6ad9-39a1-4a88-8e0d-6f9f706868a6 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.309349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1067/2116] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:49 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:25:49.314046 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051a3ba-f0ae-4184-922e-9f66db4b2a73 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.321273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1050/2117] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:49.327120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd6ad9-39a1-4a88-8e0d-6f9f706868a6 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.338622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd6ad9-39a1-4a88-8e0d-6f9f706868a6 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.392010 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051a3ba-f0ae-4184-922e-9f66db4b2a73 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.396759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bd5c5-3427-48ee-8c88-9a7a45569e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.397433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bd5c5-3427-48ee-8c88-9a7a45569e60 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.397720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bd5c5-3427-48ee-8c88-9a7a45569e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.397994 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bd5c5-3427-48ee-8c88-9a7a45569e60 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.398715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bd5c5-3427-48ee-8c88-9a7a45569e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.400670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bd5c5-3427-48ee-8c88-9a7a45569e60 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.403605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e471a-307e-4482-8da0-6d212237cbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.404551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e471a-307e-4482-8da0-6d212237cbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.404841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e471a-307e-4482-8da0-6d212237cbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.405118 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e471a-307e-4482-8da0-6d212237cbe9 admin admin] PATH_INFO: `/v3/projects/7f4a6f2c8ffd42fea7cb179fb57e7621/users/397c08957926488d879e8e6d535d2290/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.408281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e471a-307e-4482-8da0-6d212237cbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4a6f2c8ffd42fea7cb179fb57e7621, user_id=397c08957926488d879e8e6d535d2290, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.411226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e471a-307e-4482-8da0-6d212237cbe9 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.421908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1051/2118] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:49 2022] PUT /identity/v3/projects/7f4a6f2c8ffd42fea7cb179fb57e7621/users/397c08957926488d879e8e6d535d2290/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:49.427529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1068/2119] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:49 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:49.431463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e471a-307e-4482-8da0-6d212237cbe9 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.432150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f240f5-6a6d-4c79-8df5-1560095b81ad None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.432443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f240f5-6a6d-4c79-8df5-1560095b81ad None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.432719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f240f5-6a6d-4c79-8df5-1560095b81ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.460985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-01f240f5-6a6d-4c79-8df5-1560095b81ad None None] MFA Rules not processed for user `397c08957926488d879e8e6d535d2290`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:49.462505 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-01f240f5-6a6d-4c79-8df5-1560095b81ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:49.496014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e471a-307e-4482-8da0-6d212237cbe9 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.500752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebcc28-d6d7-4ede-8aea-2380b7c485be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.501422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebcc28-d6d7-4ede-8aea-2380b7c485be admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.501706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebcc28-d6d7-4ede-8aea-2380b7c485be admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.501981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebcc28-d6d7-4ede-8aea-2380b7c485be admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.502766 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebcc28-d6d7-4ede-8aea-2380b7c485be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.504662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebcc28-d6d7-4ede-8aea-2380b7c485be admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.514188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1052/2120] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:49.518206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebcc28-d6d7-4ede-8aea-2380b7c485be admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.528059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebcc28-d6d7-4ede-8aea-2380b7c485be admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.532161 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1069/2121] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:25:49.538206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e111b4d-5268-44b9-a137-3adf43559961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.539110 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e111b4d-5268-44b9-a137-3adf43559961 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.539451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e111b4d-5268-44b9-a137-3adf43559961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.539656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e111b4d-5268-44b9-a137-3adf43559961 admin admin] PATH_INFO: `/v3/projects/53e20bda2662421eaf68196d2cdafb61/users/a020660427c341fe9175077503134f12/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.544933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f240f5-6a6d-4c79-8df5-1560095b81ad None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.546346 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-01f240f5-6a6d-4c79-8df5-1560095b81ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:49.555372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e111b4d-5268-44b9-a137-3adf43559961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e20bda2662421eaf68196d2cdafb61, user_id=a020660427c341fe9175077503134f12, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.558294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e111b4d-5268-44b9-a137-3adf43559961 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.573056 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1053/2122] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:49 2022] PUT /identity/v3/projects/53e20bda2662421eaf68196d2cdafb61/users/a020660427c341fe9175077503134f12/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:25:49.576772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e111b4d-5268-44b9-a137-3adf43559961 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.605225 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f240f5-6a6d-4c79-8df5-1560095b81ad None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.639868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e111b4d-5268-44b9-a137-3adf43559961 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.645020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2438693-dde7-4b78-b1d8-ebb207c0222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.645671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2438693-dde7-4b78-b1d8-ebb207c0222b admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.645963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2438693-dde7-4b78-b1d8-ebb207c0222b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.646277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2438693-dde7-4b78-b1d8-ebb207c0222b admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.646998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2438693-dde7-4b78-b1d8-ebb207c0222b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.648605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2438693-dde7-4b78-b1d8-ebb207c0222b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.655751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1fffd-6e04-4e80-a9a6-7f6b455bf254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.656894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1fffd-6e04-4e80-a9a6-7f6b455bf254 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.656894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1fffd-6e04-4e80-a9a6-7f6b455bf254 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.657058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1fffd-6e04-4e80-a9a6-7f6b455bf254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.661789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1054/2123] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:25:49.663196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2438693-dde7-4b78-b1d8-ebb207c0222b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:49.675947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2438693-dde7-4b78-b1d8-ebb207c0222b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:49.682240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeb551-2559-47e8-abea-add018f7eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:49.683273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb551-2559-47e8-abea-add018f7eee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:49.683632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb551-2559-47e8-abea-add018f7eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:49.683917 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb551-2559-47e8-abea-add018f7eee7 admin admin] PATH_INFO: `/v3/projects/53e20bda2662421eaf68196d2cdafb61/users/a020660427c341fe9175077503134f12/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:49.686211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aeb551-2559-47e8-abea-add018f7eee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e20bda2662421eaf68196d2cdafb61, user_id=a020660427c341fe9175077503134f12, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.690300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aeb551-2559-47e8-abea-add018f7eee7 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.702175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1055/2124] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:49 2022] PUT /identity/v3/projects/53e20bda2662421eaf68196d2cdafb61/users/a020660427c341fe9175077503134f12/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:49.740204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1fffd-6e04-4e80-a9a6-7f6b455bf254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:49.740204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1fffd-6e04-4e80-a9a6-7f6b455bf254 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:49.746237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1070/2125] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:50.227536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeb551-2559-47e8-abea-add018f7eee7 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:50.300682 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeb551-2559-47e8-abea-add018f7eee7 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:50.312817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:50.313767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:50.314077 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:50.314372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] PATH_INFO: `/v3/users/132023ed0201417e83192c61e543c4e5` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:50.318233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132023ed0201417e83192c61e543c4e5)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:50.320193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:50.381799 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132023ed0201417e83192c61e543c4e5'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:50.392434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132023ed0201417e83192c61e543c4e5'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:50.393173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132023ed0201417e83192c61e543c4e5'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:50.402210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132023ed0201417e83192c61e543c4e5'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:50.417268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132023ed0201417e83192c61e543c4e5'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:50.430831 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1056/2126] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:50 2022] DELETE /identity/v3/users/132023ed0201417e83192c61e543c4e5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:50.435519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d13700-8781-4dab-bf24-c2ebeaba0246 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:50.436020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d13700-8781-4dab-bf24-c2ebeaba0246 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:50.436100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d13700-8781-4dab-bf24-c2ebeaba0246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:50.464072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-70d13700-8781-4dab-bf24-c2ebeaba0246 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:50.465354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-70d13700-8781-4dab-bf24-c2ebeaba0246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:50.591007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1071/2127] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:50.602689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:50.605488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:50.667139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548ff8-8b69-410e-94a0-eb1555c6e869 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:50.670792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21b476-dde4-4cc5-b6b5-5bad50f3da68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:50.671528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21b476-dde4-4cc5-b6b5-5bad50f3da68 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:50.671818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21b476-dde4-4cc5-b6b5-5bad50f3da68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:50.672142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21b476-dde4-4cc5-b6b5-5bad50f3da68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:50.681934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21b476-dde4-4cc5-b6b5-5bad50f3da68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:50.683405 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21b476-dde4-4cc5-b6b5-5bad50f3da68 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:50.694429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1057/2128] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:25:51.005963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d13700-8781-4dab-bf24-c2ebeaba0246 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:51.007791 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-70d13700-8781-4dab-bf24-c2ebeaba0246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:51.028783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d13700-8781-4dab-bf24-c2ebeaba0246 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:51.047809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:51.048922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:51.049155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:51.049450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] PATH_INFO: `/v3/projects/00f6f84aa47249b6a24714845399b140` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:51.050727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f6f84aa47249b6a24714845399b140)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:51.053163 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:51.125864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f6f84aa47249b6a24714845399b140', 'request_id': 'req-ca570a1d-2ec5-4240-836b-8c37bca23459'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.142243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f6f84aa47249b6a24714845399b140', 'request_id': 'req-ca570a1d-2ec5-4240-836b-8c37bca23459'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.149947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f6f84aa47249b6a24714845399b140', 'request_id': 'req-ca570a1d-2ec5-4240-836b-8c37bca23459'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.163347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] The token cache is being invalidate because project 00f6f84aa47249b6a24714845399b140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:51.164107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.164784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.167155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1072/2129] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:51 2022] DELETE /identity/v3/projects/00f6f84aa47249b6a24714845399b140 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:51.171582 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21b476-dde4-4cc5-b6b5-5bad50f3da68 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:51.186435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21b476-dde4-4cc5-b6b5-5bad50f3da68 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:51.334462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:51.336084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:51.336808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:51.337896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] PATH_INFO: `/v3/users/397c08957926488d879e8e6d535d2290` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:51.339954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397c08957926488d879e8e6d535d2290)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:51.343103 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:51.421595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397c08957926488d879e8e6d535d2290'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.430716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397c08957926488d879e8e6d535d2290'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.431439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397c08957926488d879e8e6d535d2290'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.440111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397c08957926488d879e8e6d535d2290'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.455942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4669b525-51c3-421d-a92d-9c24cbb9f1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397c08957926488d879e8e6d535d2290'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:51.465284 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1058/2130] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:51 2022] DELETE /identity/v3/users/397c08957926488d879e8e6d535d2290 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:52.044811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:52.046322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:52.060320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca570a1d-2ec5-4240-836b-8c37bca23459 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:52.134072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:52.135609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:52.136332 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:52.136849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] PATH_INFO: `/v3/projects/7f4a6f2c8ffd42fea7cb179fb57e7621` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:52.138509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4a6f2c8ffd42fea7cb179fb57e7621)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:52.141329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:52.207044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4a6f2c8ffd42fea7cb179fb57e7621', 'request_id': 'req-2ae6ee49-f267-4418-acdc-1cf82d71a18f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:52.221255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4a6f2c8ffd42fea7cb179fb57e7621', 'request_id': 'req-2ae6ee49-f267-4418-acdc-1cf82d71a18f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:52.234408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4a6f2c8ffd42fea7cb179fb57e7621', 'request_id': 'req-2ae6ee49-f267-4418-acdc-1cf82d71a18f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:52.249138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] The token cache is being invalidate because project 7f4a6f2c8ffd42fea7cb179fb57e7621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:25:52.249899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:52.251453 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2ae6ee49-f267-4418-acdc-1cf82d71a18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:52.254810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1073/2131] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:52 2022] DELETE /identity/v3/projects/7f4a6f2c8ffd42fea7cb179fb57e7621 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:52.259264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c421-5f26-490e-b7d2-856ce1097a2c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:52.259745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c421-5f26-490e-b7d2-856ce1097a2c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:52.260198 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c421-5f26-490e-b7d2-856ce1097a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:52.280422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-5f31c421-5f26-490e-b7d2-856ce1097a2c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:52.281967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5f31c421-5f26-490e-b7d2-856ce1097a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:52.369616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1059/2132] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:52.378321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b64f6-e5dc-4bd6-b6e6-06d86278ec19 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:52.379027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b64f6-e5dc-4bd6-b6e6-06d86278ec19 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:52.379940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b64f6-e5dc-4bd6-b6e6-06d86278ec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:52.408989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d55b64f6-e5dc-4bd6-b6e6-06d86278ec19 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:52.411312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d55b64f6-e5dc-4bd6-b6e6-06d86278ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:52.426920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1074/2133] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:52.429349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31c421-5f26-490e-b7d2-856ce1097a2c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:52.440293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31c421-5f26-490e-b7d2-856ce1097a2c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:52.450452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a40f5-0577-4906-8f93-01b2724206fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:52.451841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a40f5-0577-4906-8f93-01b2724206fc admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:52.452216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a40f5-0577-4906-8f93-01b2724206fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:52.452586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a40f5-0577-4906-8f93-01b2724206fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:52.453454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a40f5-0577-4906-8f93-01b2724206fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:25:52.453829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a40f5-0577-4906-8f93-01b2724206fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:52.455657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a40f5-0577-4906-8f93-01b2724206fc admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:52.470673 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1060/2134] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:25:52.473265 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b64f6-e5dc-4bd6-b6e6-06d86278ec19 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:52.490810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b64f6-e5dc-4bd6-b6e6-06d86278ec19 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:52.497830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5d6d3-c745-4488-b6af-14ac29094812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:52.498691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d6d3-c745-4488-b6af-14ac29094812 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:52.510581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d6d3-c745-4488-b6af-14ac29094812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:52.510986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d6d3-c745-4488-b6af-14ac29094812 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:52.513246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5d6d3-c745-4488-b6af-14ac29094812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:52.516693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5d6d3-c745-4488-b6af-14ac29094812 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:52.572941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1075/2135] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:52 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:52.576948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a40f5-0577-4906-8f93-01b2724206fc admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:52.590772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a40f5-0577-4906-8f93-01b2724206fc admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:52.726810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca1434-6e91-40b5-a803-870d13a1bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:52.728279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca1434-6e91-40b5-a803-870d13a1bf0d admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:52.728509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca1434-6e91-40b5-a803-870d13a1bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:52.729419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca1434-6e91-40b5-a803-870d13a1bf0d admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:52.730127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca1434-6e91-40b5-a803-870d13a1bf0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:52.732735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca1434-6e91-40b5-a803-870d13a1bf0d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:52.782462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1061/2136] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:52 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:52.783549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5d6d3-c745-4488-b6af-14ac29094812 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:52.808114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5d6d3-c745-4488-b6af-14ac29094812 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:52.814593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc342586-1640-4a96-b624-9e15a590458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:52.815549 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc342586-1640-4a96-b624-9e15a590458d admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:52.815985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc342586-1640-4a96-b624-9e15a590458d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:52.816413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc342586-1640-4a96-b624-9e15a590458d admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:52.818736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc342586-1640-4a96-b624-9e15a590458d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:52.820674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc342586-1640-4a96-b624-9e15a590458d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:52.839135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1076/2137] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:52.844844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca1434-6e91-40b5-a803-870d13a1bf0d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:52.861078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca1434-6e91-40b5-a803-870d13a1bf0d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:52.876612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae41ff-301d-42d6-ad2e-bd788a37b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:52.880515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae41ff-301d-42d6-ad2e-bd788a37b0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:52.880826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae41ff-301d-42d6-ad2e-bd788a37b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:52.881150 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae41ff-301d-42d6-ad2e-bd788a37b0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:52.882055 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae41ff-301d-42d6-ad2e-bd788a37b0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:52.889854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae41ff-301d-42d6-ad2e-bd788a37b0d5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:52.928627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1062/2138] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:52.930066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc342586-1640-4a96-b624-9e15a590458d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:52.947860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc342586-1640-4a96-b624-9e15a590458d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:52.957780 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573c26-faea-40ac-9b68-7fd63a9ea2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:52.958808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573c26-faea-40ac-9b68-7fd63a9ea2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:52.959100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573c26-faea-40ac-9b68-7fd63a9ea2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:52.959382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573c26-faea-40ac-9b68-7fd63a9ea2ce admin admin] PATH_INFO: `/v3/projects/15d66d1d14cc42698a97b19c27e58a5d/users/0623ed09b6304b49b3f1b013d230538f/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:52.985962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0573c26-faea-40ac-9b68-7fd63a9ea2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d66d1d14cc42698a97b19c27e58a5d, user_id=0623ed09b6304b49b3f1b013d230538f, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:52.989362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0573c26-faea-40ac-9b68-7fd63a9ea2ce admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:53.017300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1077/2139] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:52 2022] PUT /identity/v3/projects/15d66d1d14cc42698a97b19c27e58a5d/users/0623ed09b6304b49b3f1b013d230538f/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:53.037143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d091b3-38e7-43e9-a32a-17618b28bdff None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:53.037445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d091b3-38e7-43e9-a32a-17618b28bdff None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:53.037735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d091b3-38e7-43e9-a32a-17618b28bdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:53.099703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b0d091b3-38e7-43e9-a32a-17618b28bdff None None] MFA Rules not processed for user `0623ed09b6304b49b3f1b013d230538f`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:53.101366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b0d091b3-38e7-43e9-a32a-17618b28bdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:53.206558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1063/2140] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:53.211629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573c26-faea-40ac-9b68-7fd63a9ea2ce admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:53.289390 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573c26-faea-40ac-9b68-7fd63a9ea2ce admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:53.298668 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6533-a3f8-4257-9571-4d565a1983de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:53.299447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6533-a3f8-4257-9571-4d565a1983de admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:53.299813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6533-a3f8-4257-9571-4d565a1983de admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:53.300169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6533-a3f8-4257-9571-4d565a1983de admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:53.300961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa6533-a3f8-4257-9571-4d565a1983de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:53.303594 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa6533-a3f8-4257-9571-4d565a1983de admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:53.333738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1078/2141] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:25:53 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:53.339894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d091b3-38e7-43e9-a32a-17618b28bdff None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:53.364972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d091b3-38e7-43e9-a32a-17618b28bdff None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:53.445204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dd8a1-9f74-4db6-b1de-7f1bfc775761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:53.445993 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dd8a1-9f74-4db6-b1de-7f1bfc775761 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:53.446854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dd8a1-9f74-4db6-b1de-7f1bfc775761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:53.447210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dd8a1-9f74-4db6-b1de-7f1bfc775761 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:53.447983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dd8a1-9f74-4db6-b1de-7f1bfc775761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:53.450184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dd8a1-9f74-4db6-b1de-7f1bfc775761 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:53.474642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1064/2142] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:25:53 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:25:53.479613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6533-a3f8-4257-9571-4d565a1983de admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:53.490443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6533-a3f8-4257-9571-4d565a1983de admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:53.495472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772dbfe-9eba-4d20-b8db-ad56ea313685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:53.496157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772dbfe-9eba-4d20-b8db-ad56ea313685 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:53.496441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772dbfe-9eba-4d20-b8db-ad56ea313685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:53.496718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772dbfe-9eba-4d20-b8db-ad56ea313685 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:53.497460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772dbfe-9eba-4d20-b8db-ad56ea313685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:53.499112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772dbfe-9eba-4d20-b8db-ad56ea313685 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:53.511274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1079/2143] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:53.515535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dd8a1-9f74-4db6-b1de-7f1bfc775761 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:53.526475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dd8a1-9f74-4db6-b1de-7f1bfc775761 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:53.536415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511c1a-75cf-4169-a2de-d2aeb07128e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:53.537333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511c1a-75cf-4169-a2de-d2aeb07128e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:53.537934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511c1a-75cf-4169-a2de-d2aeb07128e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:53.537934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511c1a-75cf-4169-a2de-d2aeb07128e6 admin admin] PATH_INFO: `/v3/projects/6a9d6c3536a3422fafb3f5a176cb2bb4/users/897c724f15824189b46aae603eea3062/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:53.565389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98511c1a-75cf-4169-a2de-d2aeb07128e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9d6c3536a3422fafb3f5a176cb2bb4, user_id=897c724f15824189b46aae603eea3062, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:53.568560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98511c1a-75cf-4169-a2de-d2aeb07128e6 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:53.585123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1065/2144] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:53 2022] PUT /identity/v3/projects/6a9d6c3536a3422fafb3f5a176cb2bb4/users/897c724f15824189b46aae603eea3062/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:53.589366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772dbfe-9eba-4d20-b8db-ad56ea313685 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:53.601914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772dbfe-9eba-4d20-b8db-ad56ea313685 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:53.700008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940827b-06b8-4a20-8f0c-49fcf76d4e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:53.700850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940827b-06b8-4a20-8f0c-49fcf76d4e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:53.701208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940827b-06b8-4a20-8f0c-49fcf76d4e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:53.701559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940827b-06b8-4a20-8f0c-49fcf76d4e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:53.702527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940827b-06b8-4a20-8f0c-49fcf76d4e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:53.704287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940827b-06b8-4a20-8f0c-49fcf76d4e87 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:53.726931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1080/2145] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:25:53.731507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511c1a-75cf-4169-a2de-d2aeb07128e6 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:53.757306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511c1a-75cf-4169-a2de-d2aeb07128e6 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:53.776194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610e3cf-4ed6-41a2-94ca-c22f5b5ebda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:53.777465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610e3cf-4ed6-41a2-94ca-c22f5b5ebda8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:53.777934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610e3cf-4ed6-41a2-94ca-c22f5b5ebda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:53.778486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610e3cf-4ed6-41a2-94ca-c22f5b5ebda8 admin admin] PATH_INFO: `/v3/projects/6a9d6c3536a3422fafb3f5a176cb2bb4/users/897c724f15824189b46aae603eea3062/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:53.784992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610e3cf-4ed6-41a2-94ca-c22f5b5ebda8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9d6c3536a3422fafb3f5a176cb2bb4, user_id=897c724f15824189b46aae603eea3062, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:53.788649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610e3cf-4ed6-41a2-94ca-c22f5b5ebda8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:53.813479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1066/2146] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:25:53 2022] PUT /identity/v3/projects/6a9d6c3536a3422fafb3f5a176cb2bb4/users/897c724f15824189b46aae603eea3062/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:53.827578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76016fc-2d2c-4eac-9902-fd569281ef88 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:53.827811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76016fc-2d2c-4eac-9902-fd569281ef88 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:53.828101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76016fc-2d2c-4eac-9902-fd569281ef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:53.869102 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f76016fc-2d2c-4eac-9902-fd569281ef88 None None] MFA Rules not processed for user `897c724f15824189b46aae603eea3062`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:53.870548 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f76016fc-2d2c-4eac-9902-fd569281ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:53.981861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1081/2147] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:53.999425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610e3cf-4ed6-41a2-94ca-c22f5b5ebda8 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:54.001349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2610e3cf-4ed6-41a2-94ca-c22f5b5ebda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:54.121191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610e3cf-4ed6-41a2-94ca-c22f5b5ebda8 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:54.125311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc1226-44d6-4fc1-9d83-36760eb07eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:54.126446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc1226-44d6-4fc1-9d83-36760eb07eed service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:54.126732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc1226-44d6-4fc1-9d83-36760eb07eed service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:54.127009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc1226-44d6-4fc1-9d83-36760eb07eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:54.139400 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc1226-44d6-4fc1-9d83-36760eb07eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:54.141692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc1226-44d6-4fc1-9d83-36760eb07eed service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:54.155043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1067/2148] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:54.267217 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76016fc-2d2c-4eac-9902-fd569281ef88 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:54.268935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f76016fc-2d2c-4eac-9902-fd569281ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:54.299707 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76016fc-2d2c-4eac-9902-fd569281ef88 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:54.311497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed42ba0-02b7-4c42-8db6-6712bfbca62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:54.313365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42ba0-02b7-4c42-8db6-6712bfbca62e service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:54.313830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42ba0-02b7-4c42-8db6-6712bfbca62e service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:54.314368 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42ba0-02b7-4c42-8db6-6712bfbca62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:54.398632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed42ba0-02b7-4c42-8db6-6712bfbca62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:54.404658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed42ba0-02b7-4c42-8db6-6712bfbca62e service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:54.454092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1082/2149] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:56.105683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8830b06-0da0-4f26-8d4b-83cca25a153a None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:56.106213 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8830b06-0da0-4f26-8d4b-83cca25a153a None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:56.106314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8830b06-0da0-4f26-8d4b-83cca25a153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:56.134929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b8830b06-0da0-4f26-8d4b-83cca25a153a None None] MFA Rules not processed for user `a020660427c341fe9175077503134f12`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:56.136192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b8830b06-0da0-4f26-8d4b-83cca25a153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:56.203385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1068/2150] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:56.215411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed42ba0-02b7-4c42-8db6-6712bfbca62e service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:56.216770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-aed42ba0-02b7-4c42-8db6-6712bfbca62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:56.271396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed42ba0-02b7-4c42-8db6-6712bfbca62e service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:56.274977 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9a11df2d3d4dc292a5115de69bb288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:56.275618 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:56.275902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:56.276172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:56.277930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:56.333906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:56.335364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:56.343882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1083/2151] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:56.485801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a4cf-2c6f-41c7-8032-9cff7fd3908f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:56.485801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a4cf-2c6f-41c7-8032-9cff7fd3908f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:56.485801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a4cf-2c6f-41c7-8032-9cff7fd3908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:56.518008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-cc12a4cf-2c6f-41c7-8032-9cff7fd3908f None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:56.519711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cc12a4cf-2c6f-41c7-8032-9cff7fd3908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:56.591173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1069/2152] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:25:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:56.637351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:56.638867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:56.720143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e44679-1abe-41f6-8fc9-ee2f77404f97 service glance] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:56.725650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb0699-a457-4971-8fa5-99b0bce78ecf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:56.726336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb0699-a457-4971-8fa5-99b0bce78ecf service swift] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:56.726611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb0699-a457-4971-8fa5-99b0bce78ecf service swift] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:56.726887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb0699-a457-4971-8fa5-99b0bce78ecf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:56.734820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb0699-a457-4971-8fa5-99b0bce78ecf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:56.736433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb0699-a457-4971-8fa5-99b0bce78ecf service swift] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:56.745235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1084/2153] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:25:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:25:58.542180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12a4cf-2c6f-41c7-8032-9cff7fd3908f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:58.543674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cc12a4cf-2c6f-41c7-8032-9cff7fd3908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:58.699108 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12a4cf-2c6f-41c7-8032-9cff7fd3908f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:58.705180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:58.706257 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:58.706537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:58.707261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] PATH_INFO: `/v3/users/3909e739cc8848fc8d6273c8f2a4f9e8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:58.711409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3909e739cc8848fc8d6273c8f2a4f9e8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:58.727998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:58.834807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3909e739cc8848fc8d6273c8f2a4f9e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:58.851999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3909e739cc8848fc8d6273c8f2a4f9e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:58.852603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3909e739cc8848fc8d6273c8f2a4f9e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:58.871529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3909e739cc8848fc8d6273c8f2a4f9e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:58.914084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3909e739cc8848fc8d6273c8f2a4f9e8'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:25:58.936542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1070/2154] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:25:58 2022] DELETE /identity/v3/users/3909e739cc8848fc8d6273c8f2a4f9e8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:25:58.938427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ba55e-652b-45be-afb2-5eff61c751f0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:58.939269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ba55e-652b-45be-afb2-5eff61c751f0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:58.939700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ba55e-652b-45be-afb2-5eff61c751f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:59.009079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d76ba55e-652b-45be-afb2-5eff61c751f0 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:25:59.010349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d76ba55e-652b-45be-afb2-5eff61c751f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:59.153156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1085/2155] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:25:59.163391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:59.165960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:59.275830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9fad-346c-405a-9221-47af2c8e42e3 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:59.280057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d690e0c-06c0-4f93-bbb9-6f71d4dd4340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:59.280951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d690e0c-06c0-4f93-bbb9-6f71d4dd4340 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:59.281459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d690e0c-06c0-4f93-bbb9-6f71d4dd4340 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:59.281956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d690e0c-06c0-4f93-bbb9-6f71d4dd4340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:59.302546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d690e0c-06c0-4f93-bbb9-6f71d4dd4340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:59.304790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d690e0c-06c0-4f93-bbb9-6f71d4dd4340 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:25:59.335631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1071/2156] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:25:59.861130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ba55e-652b-45be-afb2-5eff61c751f0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:25:59.876141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d76ba55e-652b-45be-afb2-5eff61c751f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:25:59.904372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ba55e-652b-45be-afb2-5eff61c751f0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:25:59.914405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:25:59.915321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:25:59.915609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:25:59.915887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] PATH_INFO: `/v3/projects/b7ecd25c41a146719a8cd39f444b050c` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:25:59.917182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ecd25c41a146719a8cd39f444b050c)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:25:59.919212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:00.008701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ecd25c41a146719a8cd39f444b050c', 'request_id': 'req-a7349af0-50d1-4057-855d-07d2a30e389e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:00.038916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ecd25c41a146719a8cd39f444b050c', 'request_id': 'req-a7349af0-50d1-4057-855d-07d2a30e389e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:00.050404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ecd25c41a146719a8cd39f444b050c', 'request_id': 'req-a7349af0-50d1-4057-855d-07d2a30e389e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:00.063963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] The token cache is being invalidate because project b7ecd25c41a146719a8cd39f444b050c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:26:00.064691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:00.065619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a7349af0-50d1-4057-855d-07d2a30e389e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:00.068174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1086/2157] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:25:59 2022] DELETE /identity/v3/projects/b7ecd25c41a146719a8cd39f444b050c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:00.073991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7d19b-bf29-49ac-9209-f78658c843e1 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:00.074508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7d19b-bf29-49ac-9209-f78658c843e1 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:00.074508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7d19b-bf29-49ac-9209-f78658c843e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:00.100259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-4ed7d19b-bf29-49ac-9209-f78658c843e1 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:00.101917 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-4ed7d19b-bf29-49ac-9209-f78658c843e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:00.190203 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1072/2158] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:26:00.197586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c9b1c-2855-45b3-bc83-2523b04b9795 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:00.198251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c9b1c-2855-45b3-bc83-2523b04b9795 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:00.198699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c9b1c-2855-45b3-bc83-2523b04b9795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:00.221876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ed6c9b1c-2855-45b3-bc83-2523b04b9795 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:00.223539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ed6c9b1c-2855-45b3-bc83-2523b04b9795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:00.232811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1087/2159] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:00.236684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7d19b-bf29-49ac-9209-f78658c843e1 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:00.248285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7d19b-bf29-49ac-9209-f78658c843e1 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:00.257839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f76e08-c7dd-4382-906d-76b4760fbe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:00.261011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f76e08-c7dd-4382-906d-76b4760fbe36 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:00.261556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f76e08-c7dd-4382-906d-76b4760fbe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:00.262060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f76e08-c7dd-4382-906d-76b4760fbe36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:00.263718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f76e08-c7dd-4382-906d-76b4760fbe36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:26:00.264229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f76e08-c7dd-4382-906d-76b4760fbe36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:00.266853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f76e08-c7dd-4382-906d-76b4760fbe36 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:00.302991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1073/2160] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:26:00.307033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c9b1c-2855-45b3-bc83-2523b04b9795 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:00.320509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c9b1c-2855-45b3-bc83-2523b04b9795 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:00.345881 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fddfe-5016-4f87-8dd4-75d8af2db45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:00.346991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fddfe-5016-4f87-8dd4-75d8af2db45d admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:00.353192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fddfe-5016-4f87-8dd4-75d8af2db45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:00.354583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fddfe-5016-4f87-8dd4-75d8af2db45d admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:00.355746 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fddfe-5016-4f87-8dd4-75d8af2db45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:00.366060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fddfe-5016-4f87-8dd4-75d8af2db45d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:00.428932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1088/2161] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:26:00 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:26:00.431961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f76e08-c7dd-4382-906d-76b4760fbe36 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:00.447878 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f76e08-c7dd-4382-906d-76b4760fbe36 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:00.624713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d2fdb-8252-49e7-ae87-582885e6ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:00.625554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d2fdb-8252-49e7-ae87-582885e6ff6f admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:00.625865 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d2fdb-8252-49e7-ae87-582885e6ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:00.626293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d2fdb-8252-49e7-ae87-582885e6ff6f admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:00.628235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d2fdb-8252-49e7-ae87-582885e6ff6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:00.639075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d2fdb-8252-49e7-ae87-582885e6ff6f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:00.681579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1074/2162] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:26:00 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:26:00.686430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fddfe-5016-4f87-8dd4-75d8af2db45d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:00.708459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fddfe-5016-4f87-8dd4-75d8af2db45d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:00.724322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9caa-39b5-4950-876c-265279486dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:00.725104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9caa-39b5-4950-876c-265279486dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:00.725508 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9caa-39b5-4950-876c-265279486dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:00.725817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9caa-39b5-4950-876c-265279486dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:00.726715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd9caa-39b5-4950-876c-265279486dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:00.730843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd9caa-39b5-4950-876c-265279486dc1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:00.764642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1089/2163] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:00.766661 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d2fdb-8252-49e7-ae87-582885e6ff6f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:00.781670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d2fdb-8252-49e7-ae87-582885e6ff6f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:00.799512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a571675-1d97-4f74-b578-4d328eb9daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:00.799512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a571675-1d97-4f74-b578-4d328eb9daf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:00.799807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a571675-1d97-4f74-b578-4d328eb9daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:00.800015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a571675-1d97-4f74-b578-4d328eb9daf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:00.800751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a571675-1d97-4f74-b578-4d328eb9daf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:00.814154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a571675-1d97-4f74-b578-4d328eb9daf5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:00.861390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1075/2164] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:00.866177 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9caa-39b5-4950-876c-265279486dc1 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:00.885870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9caa-39b5-4950-876c-265279486dc1 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:00.895570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7496fd-e937-407d-b811-6c5458dd93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:00.896667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7496fd-e937-407d-b811-6c5458dd93d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:00.897070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7496fd-e937-407d-b811-6c5458dd93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:00.897464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7496fd-e937-407d-b811-6c5458dd93d1 admin admin] PATH_INFO: `/v3/projects/868d9faa77394355bc9160cd61ef3696/users/16fc0dcfe5c740c9a127df3a06352365/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:00.929210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7496fd-e937-407d-b811-6c5458dd93d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868d9faa77394355bc9160cd61ef3696, user_id=16fc0dcfe5c740c9a127df3a06352365, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:00.933322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7496fd-e937-407d-b811-6c5458dd93d1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:00.957710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1090/2165] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:26:00 2022] PUT /identity/v3/projects/868d9faa77394355bc9160cd61ef3696/users/16fc0dcfe5c740c9a127df3a06352365/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:00.962804 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485e97-de3f-4e3c-a0f2-326a6101f00d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:00.963261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485e97-de3f-4e3c-a0f2-326a6101f00d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:00.963649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485e97-de3f-4e3c-a0f2-326a6101f00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:00.996123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-44485e97-de3f-4e3c-a0f2-326a6101f00d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:00.997494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-44485e97-de3f-4e3c-a0f2-326a6101f00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:01.185560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1076/2166] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:01.196129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7496fd-e937-407d-b811-6c5458dd93d1 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:01.199490 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2f7496fd-e937-407d-b811-6c5458dd93d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:01.294872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7496fd-e937-407d-b811-6c5458dd93d1 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:01.299281 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b08993-9f2c-49d6-9c2b-60fa26e9ff22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:01.300130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b08993-9f2c-49d6-9c2b-60fa26e9ff22 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:01.300573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b08993-9f2c-49d6-9c2b-60fa26e9ff22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:01.301571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b08993-9f2c-49d6-9c2b-60fa26e9ff22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:01.312665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b08993-9f2c-49d6-9c2b-60fa26e9ff22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:01.314506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b08993-9f2c-49d6-9c2b-60fa26e9ff22 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:01.326961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1091/2167] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:26:02.215896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ee2c8-5b68-4849-8c29-5990473bbfbd None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:02.216504 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ee2c8-5b68-4849-8c29-5990473bbfbd None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:02.216504 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ee2c8-5b68-4849-8c29-5990473bbfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:02.257380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-1d0ee2c8-5b68-4849-8c29-5990473bbfbd None None] MFA Rules not processed for user `16fc0dcfe5c740c9a127df3a06352365`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:02.259044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1d0ee2c8-5b68-4849-8c29-5990473bbfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:02.360292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1077/2168] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:02.371339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b08993-9f2c-49d6-9c2b-60fa26e9ff22 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:02.373546 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c6b08993-9f2c-49d6-9c2b-60fa26e9ff22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:02.442152 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b08993-9f2c-49d6-9c2b-60fa26e9ff22 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:02.445956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f037f09-0ead-403e-acdb-80095360ad5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:02.446970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f037f09-0ead-403e-acdb-80095360ad5b service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:02.447374 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f037f09-0ead-403e-acdb-80095360ad5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:02.447869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f037f09-0ead-403e-acdb-80095360ad5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:02.458696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f037f09-0ead-403e-acdb-80095360ad5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:02.460188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f037f09-0ead-403e-acdb-80095360ad5b service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:02.469864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1092/2169] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:26:07.065814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99460123-fcd7-4365-ab9e-adb82a93f167 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:07.066488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99460123-fcd7-4365-ab9e-adb82a93f167 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:07.066488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99460123-fcd7-4365-ab9e-adb82a93f167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:07.084820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-99460123-fcd7-4365-ab9e-adb82a93f167 None None] MFA Rules not processed for user `16fc0dcfe5c740c9a127df3a06352365`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:07.086050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-99460123-fcd7-4365-ab9e-adb82a93f167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:07.093370 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1078/2170] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:08.351376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523803-0140-44cd-aed9-0045696d8121 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:08.351903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523803-0140-44cd-aed9-0045696d8121 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:08.351903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523803-0140-44cd-aed9-0045696d8121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:08.369482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-b1523803-0140-44cd-aed9-0045696d8121 None None] MFA Rules not processed for user `6d165ef4da394bac8cfa332f49571467`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:08.370737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b1523803-0140-44cd-aed9-0045696d8121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:08.423255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1093/2171] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:13.365754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1022f1e-6dd7-43d3-ab18-cb849ef7decc None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:13.366312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1022f1e-6dd7-43d3-ab18-cb849ef7decc None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:13.369677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1022f1e-6dd7-43d3-ab18-cb849ef7decc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:13.393176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d1022f1e-6dd7-43d3-ab18-cb849ef7decc None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:13.394670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d1022f1e-6dd7-43d3-ab18-cb849ef7decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:13.478739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1079/2172] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:26:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:13.492660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523803-0140-44cd-aed9-0045696d8121 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:13.494871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b1523803-0140-44cd-aed9-0045696d8121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:13.601949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523803-0140-44cd-aed9-0045696d8121 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:13.607270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a47b97-3ffc-44d1-955b-3fe61cc59abb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:13.607942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a47b97-3ffc-44d1-955b-3fe61cc59abb service swift] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:13.608231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a47b97-3ffc-44d1-955b-3fe61cc59abb service swift] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:13.608512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a47b97-3ffc-44d1-955b-3fe61cc59abb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:13.617600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a47b97-3ffc-44d1-955b-3fe61cc59abb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:13.619252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a47b97-3ffc-44d1-955b-3fe61cc59abb service swift] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:13.643024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1094/2173] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:26:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:26:16.823563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1022f1e-6dd7-43d3-ab18-cb849ef7decc None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:16.824979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d1022f1e-6dd7-43d3-ab18-cb849ef7decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:16.839469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1022f1e-6dd7-43d3-ab18-cb849ef7decc None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:16.844132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:16.844948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:16.845233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:16.845511 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] PATH_INFO: `/v3/users/0623ed09b6304b49b3f1b013d230538f` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:16.846740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0623ed09b6304b49b3f1b013d230538f)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:16.848768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:16.896207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0623ed09b6304b49b3f1b013d230538f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:16.914735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0623ed09b6304b49b3f1b013d230538f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:16.915431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0623ed09b6304b49b3f1b013d230538f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:16.924527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0623ed09b6304b49b3f1b013d230538f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:16.932639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a47b97-3ffc-44d1-955b-3fe61cc59abb service swift] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:16.934744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-27a47b97-3ffc-44d1-955b-3fe61cc59abb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:16.948426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ace62571-fbde-4a2f-8963-a0566f5a65af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0623ed09b6304b49b3f1b013d230538f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:16.953651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a47b97-3ffc-44d1-955b-3fe61cc59abb service swift] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:16.963699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1080/2174] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:26:16 2022] DELETE /identity/v3/users/0623ed09b6304b49b3f1b013d230538f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:16.974996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36b7de-5b60-4cc9-b204-fa115cbb54ee None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:16.975292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36b7de-5b60-4cc9-b204-fa115cbb54ee None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:16.975575 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36b7de-5b60-4cc9-b204-fa115cbb54ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:17.011070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ce36b7de-5b60-4cc9-b204-fa115cbb54ee None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:17.012544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ce36b7de-5b60-4cc9-b204-fa115cbb54ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:17.031387 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:17.032681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:17.033030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:17.033543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] PATH_INFO: `/v3/users/f68f176c9da041b2a99fea41971c81a0` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:17.035522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68f176c9da041b2a99fea41971c81a0)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:17.037515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:17.082417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1081/2175] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:17.092303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68f176c9da041b2a99fea41971c81a0'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.093048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36b7de-5b60-4cc9-b204-fa115cbb54ee None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:17.095131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ce36b7de-5b60-4cc9-b204-fa115cbb54ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:17.102688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68f176c9da041b2a99fea41971c81a0'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.113007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68f176c9da041b2a99fea41971c81a0'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.113736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68f176c9da041b2a99fea41971c81a0'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.114817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-af4bed44-c694-4d0c-875e-fffe72695213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68f176c9da041b2a99fea41971c81a0'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.143168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1095/2176] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:26:16 2022] DELETE /identity/v3/users/f68f176c9da041b2a99fea41971c81a0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:17.148911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622ae20-2b68-44c1-80b9-aa220c9f4371 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:17.149279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622ae20-2b68-44c1-80b9-aa220c9f4371 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:17.149662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622ae20-2b68-44c1-80b9-aa220c9f4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:17.173361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8622ae20-2b68-44c1-80b9-aa220c9f4371 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:17.174874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8622ae20-2b68-44c1-80b9-aa220c9f4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:17.192510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36b7de-5b60-4cc9-b204-fa115cbb54ee None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:17.255456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:17.256163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:17.256445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:17.256751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:17.260337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:17.278581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1096/2177] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:26:17.289811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622ae20-2b68-44c1-80b9-aa220c9f4371 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:17.294148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8622ae20-2b68-44c1-80b9-aa220c9f4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:17.309699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622ae20-2b68-44c1-80b9-aa220c9f4371 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:17.313876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808cff2-c469-40d3-83e2-48705de93fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:17.314569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808cff2-c469-40d3-83e2-48705de93fec service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:17.314926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808cff2-c469-40d3-83e2-48705de93fec service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:17.315123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808cff2-c469-40d3-83e2-48705de93fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:17.326158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808cff2-c469-40d3-83e2-48705de93fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:17.327542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808cff2-c469-40d3-83e2-48705de93fec service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:17.338601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1097/2178] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:26:17.350051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:17.351796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:17.364632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1082/2179] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:26:17.831911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808cff2-c469-40d3-83e2-48705de93fec service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:17.833766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3808cff2-c469-40d3-83e2-48705de93fec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:17.848039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:17.849560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:17.865914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808cff2-c469-40d3-83e2-48705de93fec service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:17.867659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a707e-164f-49b6-a58a-166cd6f69272 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:17.871410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:17.872514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:17.872788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:17.873062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] PATH_INFO: `/v3/projects/15d66d1d14cc42698a97b19c27e58a5d` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:17.874002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:17.875472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d66d1d14cc42698a97b19c27e58a5d)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:17.875599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:17.875871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:17.876398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] PATH_INFO: `/v3/projects/095778b99861451386b16276ef535102` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:17.877622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:17.878067 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=095778b99861451386b16276ef535102)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:17.880698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:17.938876 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d66d1d14cc42698a97b19c27e58a5d', 'request_id': 'req-adcd1c1e-74c9-406c-bd77-103fa67b7831'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.949778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d66d1d14cc42698a97b19c27e58a5d', 'request_id': 'req-adcd1c1e-74c9-406c-bd77-103fa67b7831'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.960080 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d66d1d14cc42698a97b19c27e58a5d', 'request_id': 'req-adcd1c1e-74c9-406c-bd77-103fa67b7831'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.973792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] The token cache is being invalidate because project 15d66d1d14cc42698a97b19c27e58a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:26:17.974272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.975128 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.979914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1098/2180] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:26:17 2022] DELETE /identity/v3/projects/15d66d1d14cc42698a97b19c27e58a5d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:17.982559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:17.985043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:17.987037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095778b99861451386b16276ef535102', 'request_id': 'req-047c0289-1bff-4187-a71c-93f24820c822'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:17.995404 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095778b99861451386b16276ef535102', 'request_id': 'req-047c0289-1bff-4187-a71c-93f24820c822'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.003081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095778b99861451386b16276ef535102', 'request_id': 'req-047c0289-1bff-4187-a71c-93f24820c822'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.013807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] The token cache is being invalidate because project 095778b99861451386b16276ef535102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:26:18.014095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.014743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.016255 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1083/2181] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:26:17 2022] DELETE /identity/v3/projects/095778b99861451386b16276ef535102 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:26:18.078002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd1c1e-74c9-406c-bd77-103fa67b7831 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:18.160457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:18.161532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:18.161806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:18.162159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] PATH_INFO: `/v3/users/897c724f15824189b46aae603eea3062` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:18.163675 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] RBAC: Authorizing `identity:delete_user(user_id=897c724f15824189b46aae603eea3062)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:18.165848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:18.230698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897c724f15824189b46aae603eea3062'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.252850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897c724f15824189b46aae603eea3062'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.283395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897c724f15824189b46aae603eea3062'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.284040 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897c724f15824189b46aae603eea3062'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.284701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-32d4d2d4-a0d6-453d-ab3a-68e64b8b518f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897c724f15824189b46aae603eea3062'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.309550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1099/2182] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:26:17 2022] DELETE /identity/v3/users/897c724f15824189b46aae603eea3062 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:18.784169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:18.786263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:18.799670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c0289-1bff-4187-a71c-93f24820c822 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:18.857360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:18.858268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:18.858557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:18.858830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] PATH_INFO: `/v3/projects/6a9d6c3536a3422fafb3f5a176cb2bb4` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:18.860054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9d6c3536a3422fafb3f5a176cb2bb4)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:18.862081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:18.917505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9d6c3536a3422fafb3f5a176cb2bb4', 'request_id': 'req-582ea520-fe72-4232-bc06-585bf8df685a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.924268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9d6c3536a3422fafb3f5a176cb2bb4', 'request_id': 'req-582ea520-fe72-4232-bc06-585bf8df685a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.931346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9d6c3536a3422fafb3f5a176cb2bb4', 'request_id': 'req-582ea520-fe72-4232-bc06-585bf8df685a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.942291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] The token cache is being invalidate because project 6a9d6c3536a3422fafb3f5a176cb2bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:26:18.942582 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.943210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-582ea520-fe72-4232-bc06-585bf8df685a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:18.944839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1084/2183] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:26:18 2022] DELETE /identity/v3/projects/6a9d6c3536a3422fafb3f5a176cb2bb4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:18.950787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de71e-7cf7-484a-84f1-90865eb75432 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:18.952331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de71e-7cf7-484a-84f1-90865eb75432 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:18.953192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de71e-7cf7-484a-84f1-90865eb75432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:18.987058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-3f3de71e-7cf7-484a-84f1-90865eb75432 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:18.988915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3f3de71e-7cf7-484a-84f1-90865eb75432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:19.059546 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1100/2184] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:19.068080 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abff3b-cea1-4aac-af29-55949ef9d8b2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.068364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abff3b-cea1-4aac-af29-55949ef9d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.068817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abff3b-cea1-4aac-af29-55949ef9d8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.088874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-37abff3b-cea1-4aac-af29-55949ef9d8b2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:19.090562 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-37abff3b-cea1-4aac-af29-55949ef9d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:19.104538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3de71e-7cf7-484a-84f1-90865eb75432 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.109606 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1085/2185] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:26:19.115042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3de71e-7cf7-484a-84f1-90865eb75432 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.120098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08032-bf16-4324-9808-e1874dc26dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.120991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08032-bf16-4324-9808-e1874dc26dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.121432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08032-bf16-4324-9808-e1874dc26dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.121866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08032-bf16-4324-9808-e1874dc26dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.122813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c08032-bf16-4324-9808-e1874dc26dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:26:19.123283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c08032-bf16-4324-9808-e1874dc26dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.125055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c08032-bf16-4324-9808-e1874dc26dd2 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.142347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1101/2186] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:26:19.149747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abff3b-cea1-4aac-af29-55949ef9d8b2 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.161832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abff3b-cea1-4aac-af29-55949ef9d8b2 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.166519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768772-e70c-4c56-8b5e-a22653ed656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.167166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768772-e70c-4c56-8b5e-a22653ed656e admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.167444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768772-e70c-4c56-8b5e-a22653ed656e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.167772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768772-e70c-4c56-8b5e-a22653ed656e admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.168417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1768772-e70c-4c56-8b5e-a22653ed656e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.170325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1768772-e70c-4c56-8b5e-a22653ed656e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.209531 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1086/2187] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:26:19 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:26:19.214005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08032-bf16-4324-9808-e1874dc26dd2 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.226970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08032-bf16-4324-9808-e1874dc26dd2 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.282088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9b237-ea3b-49f7-8d2a-0f49d85e4e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.283033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9b237-ea3b-49f7-8d2a-0f49d85e4e8d admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.283314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9b237-ea3b-49f7-8d2a-0f49d85e4e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.283587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9b237-ea3b-49f7-8d2a-0f49d85e4e8d admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.284272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9b237-ea3b-49f7-8d2a-0f49d85e4e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.286711 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9b237-ea3b-49f7-8d2a-0f49d85e4e8d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.306591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1102/2188] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:26:19 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:26:19.311565 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768772-e70c-4c56-8b5e-a22653ed656e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.325064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768772-e70c-4c56-8b5e-a22653ed656e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.332402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cfb84-e362-4505-bb32-a1d074a002aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.333223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cfb84-e362-4505-bb32-a1d074a002aa admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.333580 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cfb84-e362-4505-bb32-a1d074a002aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.333931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cfb84-e362-4505-bb32-a1d074a002aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.334797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cfb84-e362-4505-bb32-a1d074a002aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.336520 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cfb84-e362-4505-bb32-a1d074a002aa admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.348636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1087/2189] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:19.352448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9b237-ea3b-49f7-8d2a-0f49d85e4e8d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.365068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9b237-ea3b-49f7-8d2a-0f49d85e4e8d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.371312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97e0c9-0532-4666-8a0b-d3f20bb2ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.372204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e0c9-0532-4666-8a0b-d3f20bb2ee86 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.372620 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e0c9-0532-4666-8a0b-d3f20bb2ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.372975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e0c9-0532-4666-8a0b-d3f20bb2ee86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.373927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97e0c9-0532-4666-8a0b-d3f20bb2ee86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.375886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97e0c9-0532-4666-8a0b-d3f20bb2ee86 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.386621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1103/2190] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:26:19.390743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cfb84-e362-4505-bb32-a1d074a002aa admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.400858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cfb84-e362-4505-bb32-a1d074a002aa admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.405526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2d45e-523b-438b-9bbc-1e5decea5aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.406447 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2d45e-523b-438b-9bbc-1e5decea5aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.406732 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2d45e-523b-438b-9bbc-1e5decea5aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.407013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2d45e-523b-438b-9bbc-1e5decea5aaf admin admin] PATH_INFO: `/v3/projects/96d1bbb2e67c4fb79ec8f580a8d56c2a/users/3c541e2df639487087d3d4cdd0d27faa/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.422144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2d45e-523b-438b-9bbc-1e5decea5aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d1bbb2e67c4fb79ec8f580a8d56c2a, user_id=3c541e2df639487087d3d4cdd0d27faa, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.424723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2d45e-523b-438b-9bbc-1e5decea5aaf admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.438263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1088/2191] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:26:19 2022] PUT /identity/v3/projects/96d1bbb2e67c4fb79ec8f580a8d56c2a/users/3c541e2df639487087d3d4cdd0d27faa/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:19.448522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b531-54fa-4ec1-8524-7aad7b8ee2ec None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.448816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b531-54fa-4ec1-8524-7aad7b8ee2ec None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.449097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b531-54fa-4ec1-8524-7aad7b8ee2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.503258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-5944b531-54fa-4ec1-8524-7aad7b8ee2ec None None] MFA Rules not processed for user `3c541e2df639487087d3d4cdd0d27faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:19.506923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-5944b531-54fa-4ec1-8524-7aad7b8ee2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:19.580356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1104/2192] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:26:19.585193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2d45e-523b-438b-9bbc-1e5decea5aaf admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.649380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2d45e-523b-438b-9bbc-1e5decea5aaf admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.654067 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09b8be-71d7-4119-890e-3c90135a2d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.654744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09b8be-71d7-4119-890e-3c90135a2d31 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.655024 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09b8be-71d7-4119-890e-3c90135a2d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.655300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09b8be-71d7-4119-890e-3c90135a2d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.655992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09b8be-71d7-4119-890e-3c90135a2d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.658164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09b8be-71d7-4119-890e-3c90135a2d31 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.691757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1089/2193] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:26:19 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:26:19.696070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b531-54fa-4ec1-8524-7aad7b8ee2ec None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.715673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b531-54fa-4ec1-8524-7aad7b8ee2ec None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.787778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0e61e-ad83-4a0b-a3ee-87ea2cc6eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.788459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0e61e-ad83-4a0b-a3ee-87ea2cc6eae8 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.788745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0e61e-ad83-4a0b-a3ee-87ea2cc6eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.789023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0e61e-ad83-4a0b-a3ee-87ea2cc6eae8 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.789727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0e61e-ad83-4a0b-a3ee-87ea2cc6eae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.791710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0e61e-ad83-4a0b-a3ee-87ea2cc6eae8 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.817361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1105/2194] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:26:19 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:26:19.818679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09b8be-71d7-4119-890e-3c90135a2d31 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.842508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09b8be-71d7-4119-890e-3c90135a2d31 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.847990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f88e4e-9ab9-41d5-b6fc-41b364e9556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.848673 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88e4e-9ab9-41d5-b6fc-41b364e9556c admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.848961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88e4e-9ab9-41d5-b6fc-41b364e9556c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.849258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88e4e-9ab9-41d5-b6fc-41b364e9556c admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.849978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f88e4e-9ab9-41d5-b6fc-41b364e9556c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.852760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f88e4e-9ab9-41d5-b6fc-41b364e9556c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.868454 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1090/2195] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:19.872510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0e61e-ad83-4a0b-a3ee-87ea2cc6eae8 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.891013 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0e61e-ad83-4a0b-a3ee-87ea2cc6eae8 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:19.897000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ede50-ebbf-4e53-9b21-9a69af43a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:19.898142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ede50-ebbf-4e53-9b21-9a69af43a957 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:19.898513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ede50-ebbf-4e53-9b21-9a69af43a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:19.898920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ede50-ebbf-4e53-9b21-9a69af43a957 admin admin] PATH_INFO: `/v3/projects/49954cf69ea5409db805dfb88f34efc0/users/a7950264667249a3899bb07e68a12e75/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:19.915014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ede50-ebbf-4e53-9b21-9a69af43a957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49954cf69ea5409db805dfb88f34efc0, user_id=a7950264667249a3899bb07e68a12e75, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:19.917714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ede50-ebbf-4e53-9b21-9a69af43a957 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:19.940279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1106/2196] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:26:19 2022] PUT /identity/v3/projects/49954cf69ea5409db805dfb88f34efc0/users/a7950264667249a3899bb07e68a12e75/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:19.944182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f88e4e-9ab9-41d5-b6fc-41b364e9556c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:19.954037 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f88e4e-9ab9-41d5-b6fc-41b364e9556c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:20.008001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2a474-bca8-48ee-95c5-ef3219b1e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:20.008672 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2a474-bca8-48ee-95c5-ef3219b1e6bb admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:20.008959 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2a474-bca8-48ee-95c5-ef3219b1e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:20.009271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2a474-bca8-48ee-95c5-ef3219b1e6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:20.009992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2a474-bca8-48ee-95c5-ef3219b1e6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:20.011651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2a474-bca8-48ee-95c5-ef3219b1e6bb admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:20.021192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1091/2197] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:20.025485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ede50-ebbf-4e53-9b21-9a69af43a957 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:20.036455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ede50-ebbf-4e53-9b21-9a69af43a957 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:20.041306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05daca-4502-4943-be7d-194a4071f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:20.042203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05daca-4502-4943-be7d-194a4071f130 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:20.042486 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05daca-4502-4943-be7d-194a4071f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:20.042758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05daca-4502-4943-be7d-194a4071f130 admin admin] PATH_INFO: `/v3/projects/49954cf69ea5409db805dfb88f34efc0/users/a7950264667249a3899bb07e68a12e75/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:20.044742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05daca-4502-4943-be7d-194a4071f130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49954cf69ea5409db805dfb88f34efc0, user_id=a7950264667249a3899bb07e68a12e75, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:20.047449 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05daca-4502-4943-be7d-194a4071f130 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:20.060408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1107/2198] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:26:20 2022] PUT /identity/v3/projects/49954cf69ea5409db805dfb88f34efc0/users/a7950264667249a3899bb07e68a12e75/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:20.075686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b097-f30f-4ceb-97ea-225e726c3dcf None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:20.076129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b097-f30f-4ceb-97ea-225e726c3dcf None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:20.076420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b097-f30f-4ceb-97ea-225e726c3dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:20.107308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e956b097-f30f-4ceb-97ea-225e726c3dcf None None] MFA Rules not processed for user `a7950264667249a3899bb07e68a12e75`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:20.108933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e956b097-f30f-4ceb-97ea-225e726c3dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:20.178293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1092/2199] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:20.199580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05daca-4502-4943-be7d-194a4071f130 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:20.202050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9c05daca-4502-4943-be7d-194a4071f130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:20.289644 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05daca-4502-4943-be7d-194a4071f130 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:20.293516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da496af9-b1d3-401a-91f0-38ce51d1cc9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:20.295067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da496af9-b1d3-401a-91f0-38ce51d1cc9f service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:20.295366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da496af9-b1d3-401a-91f0-38ce51d1cc9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:20.295649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da496af9-b1d3-401a-91f0-38ce51d1cc9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:20.307794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da496af9-b1d3-401a-91f0-38ce51d1cc9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:20.309236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da496af9-b1d3-401a-91f0-38ce51d1cc9f service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:20.324690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1108/2200] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:26:20.423398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b097-f30f-4ceb-97ea-225e726c3dcf None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:20.432671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b097-f30f-4ceb-97ea-225e726c3dcf None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:20.436340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a11cf9-4b78-4309-836a-853eced7e35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:20.436979 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a11cf9-4b78-4309-836a-853eced7e35e service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:20.437267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a11cf9-4b78-4309-836a-853eced7e35e service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:20.437547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a11cf9-4b78-4309-836a-853eced7e35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:20.493648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a11cf9-4b78-4309-836a-853eced7e35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:20.495166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a11cf9-4b78-4309-836a-853eced7e35e service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:20.506367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1093/2201] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:26:23.115215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da496af9-b1d3-401a-91f0-38ce51d1cc9f service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:23.179868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da496af9-b1d3-401a-91f0-38ce51d1cc9f service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:23.184328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:23.185294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:23.185474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:23.185751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] PATH_INFO: `/v3/users/3c541e2df639487087d3d4cdd0d27faa` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:23.186960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c541e2df639487087d3d4cdd0d27faa)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:23.188851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:23.241435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c541e2df639487087d3d4cdd0d27faa'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:23.250211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c541e2df639487087d3d4cdd0d27faa'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:23.258854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c541e2df639487087d3d4cdd0d27faa'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:23.264103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c541e2df639487087d3d4cdd0d27faa'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:23.265254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c541e2df639487087d3d4cdd0d27faa'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:23.285383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1109/2202] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:26:23 2022] DELETE /identity/v3/users/3c541e2df639487087d3d4cdd0d27faa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:23.289905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22628d73-ede3-4265-9daa-be0cdc2a6fa8 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:23.290548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22628d73-ede3-4265-9daa-be0cdc2a6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:23.290684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22628d73-ede3-4265-9daa-be0cdc2a6fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:23.314083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-22628d73-ede3-4265-9daa-be0cdc2a6fa8 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:23.315452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-22628d73-ede3-4265-9daa-be0cdc2a6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:23.533947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1094/2203] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:26:23.550830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:23.552045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:23.614947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f49f6-944d-4662-951a-d1b0c6e9f7b0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:23.618514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206839f-ca63-4bce-be21-dbb752f45f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:23.619154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206839f-ca63-4bce-be21-dbb752f45f94 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:23.619437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206839f-ca63-4bce-be21-dbb752f45f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:23.619709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206839f-ca63-4bce-be21-dbb752f45f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:23.628352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206839f-ca63-4bce-be21-dbb752f45f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:23.629757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206839f-ca63-4bce-be21-dbb752f45f94 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:23.638973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1110/2204] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:26:23.993264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22628d73-ede3-4265-9daa-be0cdc2a6fa8 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:23.994822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-22628d73-ede3-4265-9daa-be0cdc2a6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:24.009251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22628d73-ede3-4265-9daa-be0cdc2a6fa8 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:24.014267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:24.015122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:24.015402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:24.016205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] PATH_INFO: `/v3/projects/96d1bbb2e67c4fb79ec8f580a8d56c2a` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:24.017573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d1bbb2e67c4fb79ec8f580a8d56c2a)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:24.020106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:24.064466 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d1bbb2e67c4fb79ec8f580a8d56c2a', 'request_id': 'req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.070212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d1bbb2e67c4fb79ec8f580a8d56c2a', 'request_id': 'req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.077211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d1bbb2e67c4fb79ec8f580a8d56c2a', 'request_id': 'req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.088156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] The token cache is being invalidate because project 96d1bbb2e67c4fb79ec8f580a8d56c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:26:24.088442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.089065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.090595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1095/2205] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:26:23 2022] DELETE /identity/v3/projects/96d1bbb2e67c4fb79ec8f580a8d56c2a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:24.094531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206839f-ca63-4bce-be21-dbb752f45f94 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:24.104698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206839f-ca63-4bce-be21-dbb752f45f94 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:24.181591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:24.182416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:24.182695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:24.183057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] PATH_INFO: `/v3/users/a7950264667249a3899bb07e68a12e75` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:24.184232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7950264667249a3899bb07e68a12e75)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:24.186224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:24.231107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7950264667249a3899bb07e68a12e75'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.238154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7950264667249a3899bb07e68a12e75'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.245321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7950264667249a3899bb07e68a12e75'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.245934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7950264667249a3899bb07e68a12e75'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.246556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e7f2ee6e-f597-4aec-9fde-23a99fe5b2ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7950264667249a3899bb07e68a12e75'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.267574 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1111/2206] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:26:24 2022] DELETE /identity/v3/users/a7950264667249a3899bb07e68a12e75 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:24.582272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:24.586576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:24.619597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3c15a-20db-46a5-b8c1-06c598e1dfce admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:24.702175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:24.702971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:24.703249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:24.703532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] PATH_INFO: `/v3/projects/49954cf69ea5409db805dfb88f34efc0` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:24.704759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49954cf69ea5409db805dfb88f34efc0)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:24.706963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:24.760431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49954cf69ea5409db805dfb88f34efc0', 'request_id': 'req-14be0f59-b608-4f13-afbe-209b813b1793'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.766668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49954cf69ea5409db805dfb88f34efc0', 'request_id': 'req-14be0f59-b608-4f13-afbe-209b813b1793'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.778767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49954cf69ea5409db805dfb88f34efc0', 'request_id': 'req-14be0f59-b608-4f13-afbe-209b813b1793'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.794703 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] The token cache is being invalidate because project 49954cf69ea5409db805dfb88f34efc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:26:24.794988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.795875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-14be0f59-b608-4f13-afbe-209b813b1793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:24.800806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1096/2207] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:26:24 2022] DELETE /identity/v3/projects/49954cf69ea5409db805dfb88f34efc0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:24.802698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f823f16-3f45-47e2-a0f3-c3f7649153d7 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:24.803101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f823f16-3f45-47e2-a0f3-c3f7649153d7 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:24.803495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f823f16-3f45-47e2-a0f3-c3f7649153d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:24.844305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-2f823f16-3f45-47e2-a0f3-c3f7649153d7 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:24.845473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2f823f16-3f45-47e2-a0f3-c3f7649153d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:24.912537 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1112/2208] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:24.920435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dac2-b014-4bef-820a-573e9605edaa None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:24.920723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dac2-b014-4bef-820a-573e9605edaa None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:24.920996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dac2-b014-4bef-820a-573e9605edaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:24.938668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-04f4dac2-b014-4bef-820a-573e9605edaa None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:24.939869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-04f4dac2-b014-4bef-820a-573e9605edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:24.947715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1097/2209] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:24.952029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f823f16-3f45-47e2-a0f3-c3f7649153d7 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:24.962063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f823f16-3f45-47e2-a0f3-c3f7649153d7 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:24.966594 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36766eb-4ae8-44f8-9c72-9c6be72b9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:24.967244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36766eb-4ae8-44f8-9c72-9c6be72b9a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:24.967527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36766eb-4ae8-44f8-9c72-9c6be72b9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:24.967804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36766eb-4ae8-44f8-9c72-9c6be72b9a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:24.968521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36766eb-4ae8-44f8-9c72-9c6be72b9a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:26:24.968828 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36766eb-4ae8-44f8-9c72-9c6be72b9a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:24.970444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36766eb-4ae8-44f8-9c72-9c6be72b9a71 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:24.982454 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1113/2210] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:26:24.986681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dac2-b014-4bef-820a-573e9605edaa None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:24.995805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dac2-b014-4bef-820a-573e9605edaa None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:25.000684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45b993-3625-4f45-9a09-665a4e622d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:25.001440 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45b993-3625-4f45-9a09-665a4e622d1c admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:25.001815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45b993-3625-4f45-9a09-665a4e622d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:25.002182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45b993-3625-4f45-9a09-665a4e622d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:25.004095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45b993-3625-4f45-9a09-665a4e622d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:25.005801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45b993-3625-4f45-9a09-665a4e622d1c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:25.042856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1098/2211] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:26:24 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:26:25.046582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36766eb-4ae8-44f8-9c72-9c6be72b9a71 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:25.058033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36766eb-4ae8-44f8-9c72-9c6be72b9a71 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:25.133466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab083643-ecdd-4b91-bee3-9e0bcda8224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:25.134195 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083643-ecdd-4b91-bee3-9e0bcda8224f admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:25.134492 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083643-ecdd-4b91-bee3-9e0bcda8224f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:25.134777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083643-ecdd-4b91-bee3-9e0bcda8224f admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:25.135475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab083643-ecdd-4b91-bee3-9e0bcda8224f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:25.137402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab083643-ecdd-4b91-bee3-9e0bcda8224f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:25.163591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1114/2212] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:26:25 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:26:25.167356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45b993-3625-4f45-9a09-665a4e622d1c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:25.178432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45b993-3625-4f45-9a09-665a4e622d1c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:25.183161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43656-d2b1-493e-863a-146da4d83d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:25.183911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43656-d2b1-493e-863a-146da4d83d59 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:25.184285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43656-d2b1-493e-863a-146da4d83d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:25.184633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43656-d2b1-493e-863a-146da4d83d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:25.198706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e43656-d2b1-493e-863a-146da4d83d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:25.200390 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e43656-d2b1-493e-863a-146da4d83d59 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:25.212566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1099/2213] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:25.216659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab083643-ecdd-4b91-bee3-9e0bcda8224f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:25.227850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab083643-ecdd-4b91-bee3-9e0bcda8224f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:25.233445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359e341-5529-4ab3-8810-034cf6b62807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:25.234473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359e341-5529-4ab3-8810-034cf6b62807 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:25.235151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359e341-5529-4ab3-8810-034cf6b62807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:25.235670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359e341-5529-4ab3-8810-034cf6b62807 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:25.236608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359e341-5529-4ab3-8810-034cf6b62807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:25.238896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359e341-5529-4ab3-8810-034cf6b62807 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:25.249591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1115/2214] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:25.253829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43656-d2b1-493e-863a-146da4d83d59 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:25.263642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43656-d2b1-493e-863a-146da4d83d59 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:25.268273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9131bc-4cd4-4c4f-a29f-05d36a7a54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:25.269172 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9131bc-4cd4-4c4f-a29f-05d36a7a54a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:25.269467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9131bc-4cd4-4c4f-a29f-05d36a7a54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:25.269730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9131bc-4cd4-4c4f-a29f-05d36a7a54a9 admin admin] PATH_INFO: `/v3/projects/f9c039a7bf7d4b2cac4e8ca6fde59dd4/users/0d5458044db24e25a79150f7fe50cf36/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:25.284065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9131bc-4cd4-4c4f-a29f-05d36a7a54a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c039a7bf7d4b2cac4e8ca6fde59dd4, user_id=0d5458044db24e25a79150f7fe50cf36, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:25.287322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9131bc-4cd4-4c4f-a29f-05d36a7a54a9 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:25.299780 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1100/2215] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:26:25 2022] PUT /identity/v3/projects/f9c039a7bf7d4b2cac4e8ca6fde59dd4/users/0d5458044db24e25a79150f7fe50cf36/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:26:25.311938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f8a55-4a20-4bab-a5c8-6a2c026ddd93 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:25.312235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f8a55-4a20-4bab-a5c8-6a2c026ddd93 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:25.312520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f8a55-4a20-4bab-a5c8-6a2c026ddd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:25.345943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-101f8a55-4a20-4bab-a5c8-6a2c026ddd93 None None] MFA Rules not processed for user `0d5458044db24e25a79150f7fe50cf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:25.347435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-101f8a55-4a20-4bab-a5c8-6a2c026ddd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:25.411470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1116/2216] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:25.422757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9131bc-4cd4-4c4f-a29f-05d36a7a54a9 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:25.424492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0c9131bc-4cd4-4c4f-a29f-05d36a7a54a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:25.489027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9131bc-4cd4-4c4f-a29f-05d36a7a54a9 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:25.492658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023b3dc-e84d-412c-95a3-a3f2d0274492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:25.493293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023b3dc-e84d-412c-95a3-a3f2d0274492 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:25.493574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023b3dc-e84d-412c-95a3-a3f2d0274492 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:25.493848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023b3dc-e84d-412c-95a3-a3f2d0274492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:25.501909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023b3dc-e84d-412c-95a3-a3f2d0274492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:25.503923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023b3dc-e84d-412c-95a3-a3f2d0274492 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:25.512853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1101/2217] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:26:52.333077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f8a55-4a20-4bab-a5c8-6a2c026ddd93 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:52.418691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f8a55-4a20-4bab-a5c8-6a2c026ddd93 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:52.423146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:52.425753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:52.425753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:52.425906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] PATH_INFO: `/v3/users/0d5458044db24e25a79150f7fe50cf36` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:52.427142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5458044db24e25a79150f7fe50cf36)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:52.429115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:52.477592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5458044db24e25a79150f7fe50cf36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:52.484598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5458044db24e25a79150f7fe50cf36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:52.492339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5458044db24e25a79150f7fe50cf36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:52.492990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5458044db24e25a79150f7fe50cf36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:52.493606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5458044db24e25a79150f7fe50cf36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:52.511329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1117/2218] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:26:52 2022] DELETE /identity/v3/users/0d5458044db24e25a79150f7fe50cf36 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:52.520310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1b2a7-4c4a-4a24-bc7c-bc5b577f2a3e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:52.521134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1b2a7-4c4a-4a24-bc7c-bc5b577f2a3e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:52.521596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1b2a7-4c4a-4a24-bc7c-bc5b577f2a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:52.591892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-87e1b2a7-4c4a-4a24-bc7c-bc5b577f2a3e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:52.593374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-87e1b2a7-4c4a-4a24-bc7c-bc5b577f2a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:52.654363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1102/2219] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:52.665372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:52.666813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:52.756636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104163e-c2bb-46bc-b6a6-04c46470818f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:52.760270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b747236-dd4f-4183-ac50-18fa60460395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:52.760918 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b747236-dd4f-4183-ac50-18fa60460395 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:52.761206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b747236-dd4f-4183-ac50-18fa60460395 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:52.761510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b747236-dd4f-4183-ac50-18fa60460395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:52.771023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b747236-dd4f-4183-ac50-18fa60460395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:52.772444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b747236-dd4f-4183-ac50-18fa60460395 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:52.782068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1118/2220] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:26:53.047427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1b2a7-4c4a-4a24-bc7c-bc5b577f2a3e None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.048911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-87e1b2a7-4c4a-4a24-bc7c-bc5b577f2a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:53.060403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1b2a7-4c4a-4a24-bc7c-bc5b577f2a3e None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.066065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.066948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.067225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.067494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] PATH_INFO: `/v3/projects/f9c039a7bf7d4b2cac4e8ca6fde59dd4` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.068669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c039a7bf7d4b2cac4e8ca6fde59dd4)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.071093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:53.116476 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c039a7bf7d4b2cac4e8ca6fde59dd4', 'request_id': 'req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:53.122388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c039a7bf7d4b2cac4e8ca6fde59dd4', 'request_id': 'req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:53.130802 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c039a7bf7d4b2cac4e8ca6fde59dd4', 'request_id': 'req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:53.144574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] The token cache is being invalidate because project f9c039a7bf7d4b2cac4e8ca6fde59dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:26:53.144574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:53.144574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-83d6c0b8-acb2-4ebb-9147-0e0743ad823a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:26:53.144574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1103/2221] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:26:53 2022] DELETE /identity/v3/projects/f9c039a7bf7d4b2cac4e8ca6fde59dd4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:53.148655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d8800-d4ce-43c7-be03-a7d77c7ea10e None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.148947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d8800-d4ce-43c7-be03-a7d77c7ea10e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.149225 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d8800-d4ce-43c7-be03-a7d77c7ea10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.181403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-b97d8800-d4ce-43c7-be03-a7d77c7ea10e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:53.182755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b97d8800-d4ce-43c7-be03-a7d77c7ea10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:53.248798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1119/2222] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:53.257546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb42de-afd7-418c-a13e-1a79f0ce5b5d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.257835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb42de-afd7-418c-a13e-1a79f0ce5b5d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.258136 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb42de-afd7-418c-a13e-1a79f0ce5b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.276452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-abfb42de-afd7-418c-a13e-1a79f0ce5b5d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:53.277645 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-abfb42de-afd7-418c-a13e-1a79f0ce5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:53.287738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1104/2223] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:53.292385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d8800-d4ce-43c7-be03-a7d77c7ea10e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.302618 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d8800-d4ce-43c7-be03-a7d77c7ea10e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.307640 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaadd8-e385-4b03-aa9b-56be4809dea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.308558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaadd8-e385-4b03-aa9b-56be4809dea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.309056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaadd8-e385-4b03-aa9b-56be4809dea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.309501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaadd8-e385-4b03-aa9b-56be4809dea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.311043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaadd8-e385-4b03-aa9b-56be4809dea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:26:53.311530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaadd8-e385-4b03-aa9b-56be4809dea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.313125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaadd8-e385-4b03-aa9b-56be4809dea2 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:53.334895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1120/2224] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:26:53.339222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb42de-afd7-418c-a13e-1a79f0ce5b5d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.363884 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb42de-afd7-418c-a13e-1a79f0ce5b5d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.383842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25298563-1c2a-4779-8dba-c9bcd7a97265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.384542 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25298563-1c2a-4779-8dba-c9bcd7a97265 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.384827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25298563-1c2a-4779-8dba-c9bcd7a97265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.385103 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25298563-1c2a-4779-8dba-c9bcd7a97265 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.385820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25298563-1c2a-4779-8dba-c9bcd7a97265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.387811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25298563-1c2a-4779-8dba-c9bcd7a97265 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:53.420274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1105/2225] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:26:53 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:26:53.421823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaadd8-e385-4b03-aa9b-56be4809dea2 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.433156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaadd8-e385-4b03-aa9b-56be4809dea2 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.496020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a717bc-e465-4865-8e2e-7ace8b306cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.496689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a717bc-e465-4865-8e2e-7ace8b306cef admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.496971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a717bc-e465-4865-8e2e-7ace8b306cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.497249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a717bc-e465-4865-8e2e-7ace8b306cef admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.497927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a717bc-e465-4865-8e2e-7ace8b306cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.499852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a717bc-e465-4865-8e2e-7ace8b306cef admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:53.521039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1121/2226] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:26:53 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:26:53.525116 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25298563-1c2a-4779-8dba-c9bcd7a97265 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.535769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25298563-1c2a-4779-8dba-c9bcd7a97265 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.540457 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0f47c-ef4b-4a31-961c-57c8445fcc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.541113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f47c-ef4b-4a31-961c-57c8445fcc89 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.541392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f47c-ef4b-4a31-961c-57c8445fcc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.541663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f47c-ef4b-4a31-961c-57c8445fcc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.542507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0f47c-ef4b-4a31-961c-57c8445fcc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.544057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0f47c-ef4b-4a31-961c-57c8445fcc89 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:53.555180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1106/2227] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:53.559069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a717bc-e465-4865-8e2e-7ace8b306cef admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.569845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a717bc-e465-4865-8e2e-7ace8b306cef admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.574736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f500f89-6303-45c6-bbaa-557c23a0747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.575413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f500f89-6303-45c6-bbaa-557c23a0747e admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.575705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f500f89-6303-45c6-bbaa-557c23a0747e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.575992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f500f89-6303-45c6-bbaa-557c23a0747e admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.576726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f500f89-6303-45c6-bbaa-557c23a0747e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.578379 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f500f89-6303-45c6-bbaa-557c23a0747e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:53.589764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1122/2228] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:53.593718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0f47c-ef4b-4a31-961c-57c8445fcc89 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.603477 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0f47c-ef4b-4a31-961c-57c8445fcc89 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.608044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf919ca0-4e96-4516-86f0-acfb32e653ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.608982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf919ca0-4e96-4516-86f0-acfb32e653ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.609194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf919ca0-4e96-4516-86f0-acfb32e653ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.609467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf919ca0-4e96-4516-86f0-acfb32e653ca admin admin] PATH_INFO: `/v3/projects/81e97c2ea13d4e47aa65d3a7a7ead187/users/0eb73591bc084ad08b68ed51462aefeb/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.624060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf919ca0-4e96-4516-86f0-acfb32e653ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e97c2ea13d4e47aa65d3a7a7ead187, user_id=0eb73591bc084ad08b68ed51462aefeb, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.626742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf919ca0-4e96-4516-86f0-acfb32e653ca admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:53.640551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1107/2229] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:26:53 2022] PUT /identity/v3/projects/81e97c2ea13d4e47aa65d3a7a7ead187/users/0eb73591bc084ad08b68ed51462aefeb/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:26:53.651343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bda02-d70a-492d-b849-e258a767acd8 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.651634 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bda02-d70a-492d-b849-e258a767acd8 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.651913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bda02-d70a-492d-b849-e258a767acd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.679511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-273bda02-d70a-492d-b849-e258a767acd8 None None] MFA Rules not processed for user `0eb73591bc084ad08b68ed51462aefeb`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:53.680701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-273bda02-d70a-492d-b849-e258a767acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:53.745689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1123/2230] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:53.749995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf919ca0-4e96-4516-86f0-acfb32e653ca admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.815782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf919ca0-4e96-4516-86f0-acfb32e653ca admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.823050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239c87e-84d8-42a3-8b7d-db4231845fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.823974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239c87e-84d8-42a3-8b7d-db4231845fec admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.824059 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239c87e-84d8-42a3-8b7d-db4231845fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.824303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239c87e-84d8-42a3-8b7d-db4231845fec admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.825017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239c87e-84d8-42a3-8b7d-db4231845fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.826957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239c87e-84d8-42a3-8b7d-db4231845fec admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:53.862069 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1108/2231] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:26:53 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:26:53.866511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bda02-d70a-492d-b849-e258a767acd8 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.878398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bda02-d70a-492d-b849-e258a767acd8 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.936209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07ef12-9870-43bc-948e-9037373418ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.936895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07ef12-9870-43bc-948e-9037373418ac admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.937199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07ef12-9870-43bc-948e-9037373418ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.937455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07ef12-9870-43bc-948e-9037373418ac admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.938186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07ef12-9870-43bc-948e-9037373418ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.940718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07ef12-9870-43bc-948e-9037373418ac admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:53.965478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1124/2232] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:26:53 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:26:53.966975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239c87e-84d8-42a3-8b7d-db4231845fec admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:53.977643 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239c87e-84d8-42a3-8b7d-db4231845fec admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:53.982519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10481790-8c68-4220-b334-e27ed79fb549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:53.983393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10481790-8c68-4220-b334-e27ed79fb549 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:53.983680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10481790-8c68-4220-b334-e27ed79fb549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:53.983961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10481790-8c68-4220-b334-e27ed79fb549 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:53.984688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10481790-8c68-4220-b334-e27ed79fb549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:53.987190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10481790-8c68-4220-b334-e27ed79fb549 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.002647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1109/2233] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:26:54.004683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07ef12-9870-43bc-948e-9037373418ac admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:54.014815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07ef12-9870-43bc-948e-9037373418ac admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:54.019626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a4b80-a026-4c7c-8199-6e7e4d600b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:54.020290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4b80-a026-4c7c-8199-6e7e4d600b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.020624 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4b80-a026-4c7c-8199-6e7e4d600b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.020863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4b80-a026-4c7c-8199-6e7e4d600b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.021598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4b80-a026-4c7c-8199-6e7e4d600b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:54.023319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4b80-a026-4c7c-8199-6e7e4d600b91 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.039180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1125/2234] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:54.040583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10481790-8c68-4220-b334-e27ed79fb549 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:54.052764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10481790-8c68-4220-b334-e27ed79fb549 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:54.057839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169002d-eafe-4b82-97e3-9b57d119b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:54.058948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169002d-eafe-4b82-97e3-9b57d119b4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.059047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169002d-eafe-4b82-97e3-9b57d119b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.059274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169002d-eafe-4b82-97e3-9b57d119b4e8 admin admin] PATH_INFO: `/v3/projects/6751b742c88348c284bdccd2ea562745/users/80555282bfd048019cffa5804a49b55f/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.077848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169002d-eafe-4b82-97e3-9b57d119b4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6751b742c88348c284bdccd2ea562745, user_id=80555282bfd048019cffa5804a49b55f, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:54.081335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169002d-eafe-4b82-97e3-9b57d119b4e8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.096624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1110/2235] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:26:54 2022] PUT /identity/v3/projects/6751b742c88348c284bdccd2ea562745/users/80555282bfd048019cffa5804a49b55f/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:54.107603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1681237-d5b9-4155-b2e3-84d8a0a0c7bb None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.107896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1681237-d5b9-4155-b2e3-84d8a0a0c7bb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.108158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1681237-d5b9-4155-b2e3-84d8a0a0c7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.136509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-b1681237-d5b9-4155-b2e3-84d8a0a0c7bb None None] MFA Rules not processed for user `80555282bfd048019cffa5804a49b55f`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:54.137923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b1681237-d5b9-4155-b2e3-84d8a0a0c7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:54.202685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1126/2236] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:26:54.207198 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169002d-eafe-4b82-97e3-9b57d119b4e8 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:54.265518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169002d-eafe-4b82-97e3-9b57d119b4e8 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:54.270089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c5041-7405-461b-8d7c-37695cc1f569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:54.270835 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5041-7405-461b-8d7c-37695cc1f569 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.271118 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5041-7405-461b-8d7c-37695cc1f569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.271393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5041-7405-461b-8d7c-37695cc1f569 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.272071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c5041-7405-461b-8d7c-37695cc1f569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:54.273975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c5041-7405-461b-8d7c-37695cc1f569 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.299536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1111/2237] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:26:54 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:26:54.303792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1681237-d5b9-4155-b2e3-84d8a0a0c7bb None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:54.314459 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1681237-d5b9-4155-b2e3-84d8a0a0c7bb None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:54.368708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d21dc-37a5-4e24-a011-4d27c4aa4692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:54.369623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d21dc-37a5-4e24-a011-4d27c4aa4692 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.370801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d21dc-37a5-4e24-a011-4d27c4aa4692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.370801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d21dc-37a5-4e24-a011-4d27c4aa4692 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.370983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d21dc-37a5-4e24-a011-4d27c4aa4692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:54.372994 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d21dc-37a5-4e24-a011-4d27c4aa4692 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.398773 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1127/2238] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:26:54 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:26:54.402950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c5041-7405-461b-8d7c-37695cc1f569 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:54.413780 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c5041-7405-461b-8d7c-37695cc1f569 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:54.418654 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568673c-f839-4fcf-8a59-e22ad1737a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:54.419361 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568673c-f839-4fcf-8a59-e22ad1737a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.419645 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568673c-f839-4fcf-8a59-e22ad1737a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.419980 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568673c-f839-4fcf-8a59-e22ad1737a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.420714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568673c-f839-4fcf-8a59-e22ad1737a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:54.428674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568673c-f839-4fcf-8a59-e22ad1737a3b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.442095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1112/2239] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:54.446273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d21dc-37a5-4e24-a011-4d27c4aa4692 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:54.457321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d21dc-37a5-4e24-a011-4d27c4aa4692 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:54.464893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7017f0-3466-4b2f-9510-66bd17eea90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:54.465812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7017f0-3466-4b2f-9510-66bd17eea90c admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.466098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7017f0-3466-4b2f-9510-66bd17eea90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.466404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7017f0-3466-4b2f-9510-66bd17eea90c admin admin] PATH_INFO: `/v3/projects/3144d27221db4bd2b200c853af2def74/users/a72ef124df2f46aeb35ad07d33620a50/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.488631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7017f0-3466-4b2f-9510-66bd17eea90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3144d27221db4bd2b200c853af2def74, user_id=a72ef124df2f46aeb35ad07d33620a50, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:54.491429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7017f0-3466-4b2f-9510-66bd17eea90c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.507474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1128/2240] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:26:54 2022] PUT /identity/v3/projects/3144d27221db4bd2b200c853af2def74/users/a72ef124df2f46aeb35ad07d33620a50/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:54.511347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568673c-f839-4fcf-8a59-e22ad1737a3b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:54.522384 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568673c-f839-4fcf-8a59-e22ad1737a3b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:54.576807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67378f4-466e-4293-8d12-0cc689d3f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:54.577414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67378f4-466e-4293-8d12-0cc689d3f33a admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.577696 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67378f4-466e-4293-8d12-0cc689d3f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.577975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67378f4-466e-4293-8d12-0cc689d3f33a admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.578740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67378f4-466e-4293-8d12-0cc689d3f33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:54.580863 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67378f4-466e-4293-8d12-0cc689d3f33a admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.590397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1113/2241] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:26:54.594607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7017f0-3466-4b2f-9510-66bd17eea90c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:54.605525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7017f0-3466-4b2f-9510-66bd17eea90c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:54.610204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00f86e-a118-44b3-b10f-719e04072596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:54.611085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00f86e-a118-44b3-b10f-719e04072596 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.611420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00f86e-a118-44b3-b10f-719e04072596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.611698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00f86e-a118-44b3-b10f-719e04072596 admin admin] PATH_INFO: `/v3/projects/3144d27221db4bd2b200c853af2def74/users/a72ef124df2f46aeb35ad07d33620a50/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.613678 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00f86e-a118-44b3-b10f-719e04072596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3144d27221db4bd2b200c853af2def74, user_id=a72ef124df2f46aeb35ad07d33620a50, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:54.616349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00f86e-a118-44b3-b10f-719e04072596 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.626124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1129/2242] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:26:54 2022] PUT /identity/v3/projects/3144d27221db4bd2b200c853af2def74/users/a72ef124df2f46aeb35ad07d33620a50/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:26:54.636048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69cb0c-e527-421a-a2fb-3eb6fb3a7e51 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.636346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69cb0c-e527-421a-a2fb-3eb6fb3a7e51 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.636632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69cb0c-e527-421a-a2fb-3eb6fb3a7e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.663064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2d69cb0c-e527-421a-a2fb-3eb6fb3a7e51 None None] MFA Rules not processed for user `a72ef124df2f46aeb35ad07d33620a50`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:54.664259 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2d69cb0c-e527-421a-a2fb-3eb6fb3a7e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:54.727650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1114/2243] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:54.738755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00f86e-a118-44b3-b10f-719e04072596 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:54.740475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ab00f86e-a118-44b3-b10f-719e04072596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:54.801270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00f86e-a118-44b3-b10f-719e04072596 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:54.804956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c03f2-44f3-4d34-975f-db9d7befd365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:54.805609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c03f2-44f3-4d34-975f-db9d7befd365 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:54.805895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c03f2-44f3-4d34-975f-db9d7befd365 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:54.806202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c03f2-44f3-4d34-975f-db9d7befd365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:54.860636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c03f2-44f3-4d34-975f-db9d7befd365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:54.861984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c03f2-44f3-4d34-975f-db9d7befd365 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:54.870680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1130/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:26:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:26:59.472420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f7dcb-ead8-44b0-b8c6-9356b15c8f5e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:59.473302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f7dcb-ead8-44b0-b8c6-9356b15c8f5e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:59.473302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f7dcb-ead8-44b0-b8c6-9356b15c8f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:59.495109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d35f7dcb-ead8-44b0-b8c6-9356b15c8f5e None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:26:59.496238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d35f7dcb-ead8-44b0-b8c6-9356b15c8f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:59.559849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1115/2245] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:26:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:26:59.589190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c03f2-44f3-4d34-975f-db9d7befd365 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:26:59.590763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ab3c03f2-44f3-4d34-975f-db9d7befd365 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:26:59.677489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c03f2-44f3-4d34-975f-db9d7befd365 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:26:59.682411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229903bf-8c44-469a-bfde-7529765c84df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:26:59.683064 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229903bf-8c44-469a-bfde-7529765c84df service swift] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:26:59.683347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229903bf-8c44-469a-bfde-7529765c84df service swift] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:26:59.683622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229903bf-8c44-469a-bfde-7529765c84df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:26:59.692530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229903bf-8c44-469a-bfde-7529765c84df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:26:59.694183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229903bf-8c44-469a-bfde-7529765c84df service swift] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:26:59.703237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1131/2246] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:26:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:27:00.678498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f7dcb-ead8-44b0-b8c6-9356b15c8f5e None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:00.688255 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f7dcb-ead8-44b0-b8c6-9356b15c8f5e None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:00.692634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30456165-8924-4608-80fe-62639dc91580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:00.693441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30456165-8924-4608-80fe-62639dc91580 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:00.693631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30456165-8924-4608-80fe-62639dc91580 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:00.693886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30456165-8924-4608-80fe-62639dc91580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:00.750813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30456165-8924-4608-80fe-62639dc91580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:00.752856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30456165-8924-4608-80fe-62639dc91580 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:00.762524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1116/2247] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:27:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:27:01.386614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229903bf-8c44-469a-bfde-7529765c84df service swift] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:01.399048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229903bf-8c44-469a-bfde-7529765c84df service swift] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:01.404151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705b08-3eb5-4a5b-b106-2bfc277cb1b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:01.405330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705b08-3eb5-4a5b-b106-2bfc277cb1b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:01.405623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705b08-3eb5-4a5b-b106-2bfc277cb1b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:01.405963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705b08-3eb5-4a5b-b106-2bfc277cb1b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:01.418932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705b08-3eb5-4a5b-b106-2bfc277cb1b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:01.420595 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705b08-3eb5-4a5b-b106-2bfc277cb1b0 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:01.433512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1132/2248] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:27:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:27:06.567348 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30456165-8924-4608-80fe-62639dc91580 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:06.663584 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30456165-8924-4608-80fe-62639dc91580 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:06.668814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:06.669739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:06.670022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:06.670337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] PATH_INFO: `/v3/users/0eb73591bc084ad08b68ed51462aefeb` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:06.671591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb73591bc084ad08b68ed51462aefeb)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:06.674359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:06.725621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb73591bc084ad08b68ed51462aefeb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:06.734132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb73591bc084ad08b68ed51462aefeb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:06.734854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb73591bc084ad08b68ed51462aefeb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:06.742493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb73591bc084ad08b68ed51462aefeb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:06.758367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb73591bc084ad08b68ed51462aefeb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:06.765301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1117/2249] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:27:06 2022] DELETE /identity/v3/users/0eb73591bc084ad08b68ed51462aefeb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:06.770564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061fa5c-98bb-4eb2-b5e1-8ad82fdf3340 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:06.771112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061fa5c-98bb-4eb2-b5e1-8ad82fdf3340 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:06.771112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061fa5c-98bb-4eb2-b5e1-8ad82fdf3340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:06.795700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c061fa5c-98bb-4eb2-b5e1-8ad82fdf3340 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:27:06.797211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c061fa5c-98bb-4eb2-b5e1-8ad82fdf3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:06.860697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1133/2250] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:27:06.871042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:06.872581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:06.961371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5744-8d02-4704-9d80-b514a6be0c25 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:06.966588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d76da8-3ffe-4ef4-ae5c-a72e65d7a384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:06.967352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d76da8-3ffe-4ef4-ae5c-a72e65d7a384 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:06.967642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d76da8-3ffe-4ef4-ae5c-a72e65d7a384 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:06.967923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d76da8-3ffe-4ef4-ae5c-a72e65d7a384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:06.979609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d76da8-3ffe-4ef4-ae5c-a72e65d7a384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:06.981070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d76da8-3ffe-4ef4-ae5c-a72e65d7a384 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:07.000368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1118/2251] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:27:07.287868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061fa5c-98bb-4eb2-b5e1-8ad82fdf3340 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:07.292874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c061fa5c-98bb-4eb2-b5e1-8ad82fdf3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:07.320934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061fa5c-98bb-4eb2-b5e1-8ad82fdf3340 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:07.326593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:07.327569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:07.327849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:07.328123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] PATH_INFO: `/v3/projects/81e97c2ea13d4e47aa65d3a7a7ead187` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:07.329287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e97c2ea13d4e47aa65d3a7a7ead187)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:07.331330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:07.385004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e97c2ea13d4e47aa65d3a7a7ead187', 'request_id': 'req-0d2e3081-af57-4ab0-a516-7e70279485c3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.394213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e97c2ea13d4e47aa65d3a7a7ead187', 'request_id': 'req-0d2e3081-af57-4ab0-a516-7e70279485c3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.401758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e97c2ea13d4e47aa65d3a7a7ead187', 'request_id': 'req-0d2e3081-af57-4ab0-a516-7e70279485c3'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.415616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] The token cache is being invalidate because project 81e97c2ea13d4e47aa65d3a7a7ead187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:27:07.415616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.415616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.419494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1134/2252] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:27:07 2022] DELETE /identity/v3/projects/81e97c2ea13d4e47aa65d3a7a7ead187 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:07.424189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d76da8-3ffe-4ef4-ae5c-a72e65d7a384 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:07.436810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d76da8-3ffe-4ef4-ae5c-a72e65d7a384 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:07.531641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:07.532903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:07.533262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:07.533585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] PATH_INFO: `/v3/users/80555282bfd048019cffa5804a49b55f` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:07.535052 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80555282bfd048019cffa5804a49b55f)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:07.537139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:07.602847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80555282bfd048019cffa5804a49b55f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.612044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80555282bfd048019cffa5804a49b55f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.612808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80555282bfd048019cffa5804a49b55f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.620970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80555282bfd048019cffa5804a49b55f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.637854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80555282bfd048019cffa5804a49b55f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:07.644905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1119/2253] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:27:07 2022] DELETE /identity/v3/users/80555282bfd048019cffa5804a49b55f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:27:08.082558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:08.086281 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:08.106650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e3081-af57-4ab0-a516-7e70279485c3 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:08.170860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:08.171778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:08.172071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:08.172402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] PATH_INFO: `/v3/projects/6751b742c88348c284bdccd2ea562745` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:08.175967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6751b742c88348c284bdccd2ea562745)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:08.178439 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:08.226304 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6751b742c88348c284bdccd2ea562745', 'request_id': 'req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.234575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6751b742c88348c284bdccd2ea562745', 'request_id': 'req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.241442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6751b742c88348c284bdccd2ea562745', 'request_id': 'req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.252531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] The token cache is being invalidate because project 6751b742c88348c284bdccd2ea562745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:27:08.252842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.253514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.255115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1135/2254] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:27:08 2022] DELETE /identity/v3/projects/6751b742c88348c284bdccd2ea562745 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:08.259327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:08.260721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:08.273111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86f82d-3bfa-45b1-8bc9-438f82cf6cf3 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:08.328143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:08.329009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:08.329290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:08.329592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] PATH_INFO: `/v3/users/a72ef124df2f46aeb35ad07d33620a50` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:08.330783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72ef124df2f46aeb35ad07d33620a50)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:08.332698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:08.379424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72ef124df2f46aeb35ad07d33620a50'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.386771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72ef124df2f46aeb35ad07d33620a50'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.387445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72ef124df2f46aeb35ad07d33620a50'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.395199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72ef124df2f46aeb35ad07d33620a50'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.407681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aca6efbb-e9f1-4a1c-b674-09b67c047288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72ef124df2f46aeb35ad07d33620a50'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:08.413631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1120/2255] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:27:08 2022] DELETE /identity/v3/users/a72ef124df2f46aeb35ad07d33620a50 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:08.772623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:08.774987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:08.802461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ded5cf-3b7a-4507-9af7-1226fef3e8d1 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:08.926975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:08.931810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:08.933665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:08.934590 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] PATH_INFO: `/v3/projects/3144d27221db4bd2b200c853af2def74` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:08.936056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3144d27221db4bd2b200c853af2def74)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:08.938251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:08.999574 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3144d27221db4bd2b200c853af2def74', 'request_id': 'req-73b4fe87-0631-448c-9c6f-fb0df5450d30'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:09.010813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3144d27221db4bd2b200c853af2def74', 'request_id': 'req-73b4fe87-0631-448c-9c6f-fb0df5450d30'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:09.020389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3144d27221db4bd2b200c853af2def74', 'request_id': 'req-73b4fe87-0631-448c-9c6f-fb0df5450d30'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:09.035295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] The token cache is being invalidate because project 3144d27221db4bd2b200c853af2def74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:27:09.036388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:09.037482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-73b4fe87-0631-448c-9c6f-fb0df5450d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:09.039798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1136/2256] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:27:08 2022] DELETE /identity/v3/projects/3144d27221db4bd2b200c853af2def74 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:09.044763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d786-5caf-4daf-acf9-854ff45b95fc None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.045344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d786-5caf-4daf-acf9-854ff45b95fc None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.045566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d786-5caf-4daf-acf9-854ff45b95fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.125067 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d931d786-5caf-4daf-acf9-854ff45b95fc None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:27:09.126475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d931d786-5caf-4daf-acf9-854ff45b95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:09.195422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1121/2257] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:27:09.206823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c05ed2-37e0-4706-b70c-8ed4e9c16452 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.208978 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c05ed2-37e0-4706-b70c-8ed4e9c16452 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.209578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c05ed2-37e0-4706-b70c-8ed4e9c16452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.237133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-78c05ed2-37e0-4706-b70c-8ed4e9c16452 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:27:09.238709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-78c05ed2-37e0-4706-b70c-8ed4e9c16452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:09.254835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1137/2258] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:27:09.258034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931d786-5caf-4daf-acf9-854ff45b95fc None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:09.269622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931d786-5caf-4daf-acf9-854ff45b95fc None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:09.292001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b6f69-ea38-44e4-bb09-3368ee8006d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:09.292001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b6f69-ea38-44e4-bb09-3368ee8006d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.292001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b6f69-ea38-44e4-bb09-3368ee8006d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.292001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b6f69-ea38-44e4-bb09-3368ee8006d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.292509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b6f69-ea38-44e4-bb09-3368ee8006d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:27:09.292688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b6f69-ea38-44e4-bb09-3368ee8006d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:09.294456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b6f69-ea38-44e4-bb09-3368ee8006d4 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:09.309062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1122/2259] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:27:09.312366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c05ed2-37e0-4706-b70c-8ed4e9c16452 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:09.325812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c05ed2-37e0-4706-b70c-8ed4e9c16452 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:09.331490 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa282f-1a0b-4039-a480-d83b261ec4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:09.332374 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa282f-1a0b-4039-a480-d83b261ec4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.332661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa282f-1a0b-4039-a480-d83b261ec4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.332938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa282f-1a0b-4039-a480-d83b261ec4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.333802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa282f-1a0b-4039-a480-d83b261ec4a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:09.335776 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa282f-1a0b-4039-a480-d83b261ec4a9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:09.370324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1138/2260] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:27:09 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:27:09.374841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b6f69-ea38-44e4-bb09-3368ee8006d4 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:09.386439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b6f69-ea38-44e4-bb09-3368ee8006d4 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:09.483697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014003-ae43-41b3-b536-7660757009bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:09.484543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014003-ae43-41b3-b536-7660757009bd admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.484957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014003-ae43-41b3-b536-7660757009bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.485329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014003-ae43-41b3-b536-7660757009bd admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.486954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014003-ae43-41b3-b536-7660757009bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:09.489135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014003-ae43-41b3-b536-7660757009bd admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:09.515813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1123/2261] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:27:09 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:27:09.517172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa282f-1a0b-4039-a480-d83b261ec4a9 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:09.534828 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa282f-1a0b-4039-a480-d83b261ec4a9 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:09.544106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4738e3-39e2-4123-9b45-4918c6ad5881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:09.544871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4738e3-39e2-4123-9b45-4918c6ad5881 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.545274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4738e3-39e2-4123-9b45-4918c6ad5881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.545850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4738e3-39e2-4123-9b45-4918c6ad5881 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.547098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4738e3-39e2-4123-9b45-4918c6ad5881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:09.548323 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4738e3-39e2-4123-9b45-4918c6ad5881 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:09.561622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1139/2262] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:27:09.565933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014003-ae43-41b3-b536-7660757009bd admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:09.582484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014003-ae43-41b3-b536-7660757009bd admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:09.587749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d936-c2be-4d63-9f66-4e1b9fe33df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:09.588426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d936-c2be-4d63-9f66-4e1b9fe33df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.588715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d936-c2be-4d63-9f66-4e1b9fe33df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.588990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d936-c2be-4d63-9f66-4e1b9fe33df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.589724 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d936-c2be-4d63-9f66-4e1b9fe33df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:09.592235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d936-c2be-4d63-9f66-4e1b9fe33df2 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:09.618473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1124/2263] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:27:09.619704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4738e3-39e2-4123-9b45-4918c6ad5881 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:09.632714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4738e3-39e2-4123-9b45-4918c6ad5881 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:09.640010 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b57e-256c-4dbc-92c2-b347289f2834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:09.640937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b57e-256c-4dbc-92c2-b347289f2834 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.641539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b57e-256c-4dbc-92c2-b347289f2834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.641770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b57e-256c-4dbc-92c2-b347289f2834 admin admin] PATH_INFO: `/v3/projects/ee7671e8b518403294b72760c6adef1e/users/8e9c6fa9fa30466989f8135fb412d6ff/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.666263 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612b57e-256c-4dbc-92c2-b347289f2834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7671e8b518403294b72760c6adef1e, user_id=8e9c6fa9fa30466989f8135fb412d6ff, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:09.669143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612b57e-256c-4dbc-92c2-b347289f2834 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:09.685648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1140/2264] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:27:09 2022] PUT /identity/v3/projects/ee7671e8b518403294b72760c6adef1e/users/8e9c6fa9fa30466989f8135fb412d6ff/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:27:09.698634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e906a8-e8ed-4160-b42c-14dfebea54de None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.698942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e906a8-e8ed-4160-b42c-14dfebea54de None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.699272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e906a8-e8ed-4160-b42c-14dfebea54de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.732543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b0e906a8-e8ed-4160-b42c-14dfebea54de None None] MFA Rules not processed for user `8e9c6fa9fa30466989f8135fb412d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:27:09.733943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b0e906a8-e8ed-4160-b42c-14dfebea54de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:09.806262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1125/2265] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:27:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:27:09.818382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b57e-256c-4dbc-92c2-b347289f2834 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:09.820228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3612b57e-256c-4dbc-92c2-b347289f2834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:09.886240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b57e-256c-4dbc-92c2-b347289f2834 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:09.890145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400931c8-c88c-4209-a282-e1649c8871fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:09.890835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400931c8-c88c-4209-a282-e1649c8871fe service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:09.891162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400931c8-c88c-4209-a282-e1649c8871fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:09.891470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400931c8-c88c-4209-a282-e1649c8871fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:09.902645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400931c8-c88c-4209-a282-e1649c8871fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:09.904176 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400931c8-c88c-4209-a282-e1649c8871fe service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:09.914178 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1141/2266] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:27:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:27:09.943905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e906a8-e8ed-4160-b42c-14dfebea54de None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:10.016231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e906a8-e8ed-4160-b42c-14dfebea54de None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:10.021238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:10.022444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:10.022735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:10.023034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] PATH_INFO: `/v3/users/8e9c6fa9fa30466989f8135fb412d6ff` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:10.024518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9c6fa9fa30466989f8135fb412d6ff)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:10.026713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:10.078356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9c6fa9fa30466989f8135fb412d6ff'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.087620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9c6fa9fa30466989f8135fb412d6ff'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.088234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9c6fa9fa30466989f8135fb412d6ff'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.096110 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9c6fa9fa30466989f8135fb412d6ff'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.108893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9c6fa9fa30466989f8135fb412d6ff'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.115379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1126/2267] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:27:09 2022] DELETE /identity/v3/users/8e9c6fa9fa30466989f8135fb412d6ff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:10.120085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8acf52-655a-4eb4-99dc-ab9be707e78a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:10.120399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8acf52-655a-4eb4-99dc-ab9be707e78a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:10.120688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8acf52-655a-4eb4-99dc-ab9be707e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:10.141081 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0f8acf52-655a-4eb4-99dc-ab9be707e78a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:27:10.143056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0f8acf52-655a-4eb4-99dc-ab9be707e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:10.229093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1142/2268] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:27:10.240666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:10.242784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:10.323653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedc049-0fbe-42a0-ba8c-76014317a310 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:10.330545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbe1f8-9d2c-4d09-949e-010f0b5a8404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:10.334188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbe1f8-9d2c-4d09-949e-010f0b5a8404 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:10.334188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbe1f8-9d2c-4d09-949e-010f0b5a8404 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:10.334188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbe1f8-9d2c-4d09-949e-010f0b5a8404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:10.350135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbe1f8-9d2c-4d09-949e-010f0b5a8404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:10.350135 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbe1f8-9d2c-4d09-949e-010f0b5a8404 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:10.375566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1127/2269] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:27:10.797167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8acf52-655a-4eb4-99dc-ab9be707e78a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:10.799659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0f8acf52-655a-4eb4-99dc-ab9be707e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:10.831692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8acf52-655a-4eb4-99dc-ab9be707e78a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:10.840059 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:10.841009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:10.842009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:10.842417 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] PATH_INFO: `/v3/projects/ee7671e8b518403294b72760c6adef1e` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:10.844568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7671e8b518403294b72760c6adef1e)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:10.847168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:10.900136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7671e8b518403294b72760c6adef1e', 'request_id': 'req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.910721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7671e8b518403294b72760c6adef1e', 'request_id': 'req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.918050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7671e8b518403294b72760c6adef1e', 'request_id': 'req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.929029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] The token cache is being invalidate because project ee7671e8b518403294b72760c6adef1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:27:10.929398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.930161 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5aede0ad-f810-463f-a0fe-1d8a6c6fcef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:10.931821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1143/2270] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:27:10 2022] DELETE /identity/v3/projects/ee7671e8b518403294b72760c6adef1e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:16.408060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbe1f8-9d2c-4d09-949e-010f0b5a8404 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:16.409655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-97bbe1f8-9d2c-4d09-949e-010f0b5a8404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:16.421856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbe1f8-9d2c-4d09-949e-010f0b5a8404 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:16.468389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:16.469033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:16.469315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:16.469743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:16.472517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:16.542438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:16.543913 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:16.554834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1128/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:27:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:27:25.142458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3dcb1-d130-4293-b2a2-39ea3ef6f60b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:25.142965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3dcb1-d130-4293-b2a2-39ea3ef6f60b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:25.143058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3dcb1-d130-4293-b2a2-39ea3ef6f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:25.170154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a5e3dcb1-d130-4293-b2a2-39ea3ef6f60b None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:27:25.171331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a5e3dcb1-d130-4293-b2a2-39ea3ef6f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:25.229609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1144/2272] 10.222.0.16 () {58 vars in 967 bytes} [Thu Mar 10 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:27:25.242820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:25.244219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:25.311860 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474efb0-c1c7-44b0-b781-3d6f6b50d324 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:25.317563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4932-6c33-4d20-aeee-e771ed0fa077 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:25.318241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4932-6c33-4d20-aeee-e771ed0fa077 service swift] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:25.318529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4932-6c33-4d20-aeee-e771ed0fa077 service swift] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:25.318836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4932-6c33-4d20-aeee-e771ed0fa077 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:25.327532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd4932-6c33-4d20-aeee-e771ed0fa077 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:25.329679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd4932-6c33-4d20-aeee-e771ed0fa077 service swift] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:25.337759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1129/2273] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:27:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:27:27.243879 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3dcb1-d130-4293-b2a2-39ea3ef6f60b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:27.245529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a5e3dcb1-d130-4293-b2a2-39ea3ef6f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:27.317330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3dcb1-d130-4293-b2a2-39ea3ef6f60b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:27.318022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:27.318947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:27.319230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:27.319506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] PATH_INFO: `/v3/users/b12e82c478d84f30b9e8eaec84531869` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:27.320719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12e82c478d84f30b9e8eaec84531869)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:27.322689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:27.369186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12e82c478d84f30b9e8eaec84531869'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.376167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12e82c478d84f30b9e8eaec84531869'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.384460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12e82c478d84f30b9e8eaec84531869'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.385017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12e82c478d84f30b9e8eaec84531869'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.385615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-56aa9257-712e-448f-b6ba-19b151d54749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12e82c478d84f30b9e8eaec84531869'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.402778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1145/2274] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:27:27 2022] DELETE /identity/v3/users/b12e82c478d84f30b9e8eaec84531869 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:27.575378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4932-6c33-4d20-aeee-e771ed0fa077 service swift] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:27.588276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4932-6c33-4d20-aeee-e771ed0fa077 service swift] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:27.643128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:27.643922 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:27.644208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:27.644488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] PATH_INFO: `/v3/projects/dc8de18800bb46d2a1f59a4d437dc968` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:27.645672 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8de18800bb46d2a1f59a4d437dc968)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:27.647605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:27.691796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8de18800bb46d2a1f59a4d437dc968', 'request_id': 'req-2ece396d-473e-4a40-b39e-529d9c6eecdb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.697780 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8de18800bb46d2a1f59a4d437dc968', 'request_id': 'req-2ece396d-473e-4a40-b39e-529d9c6eecdb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.706012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8de18800bb46d2a1f59a4d437dc968', 'request_id': 'req-2ece396d-473e-4a40-b39e-529d9c6eecdb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.716313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] The token cache is being invalidate because project dc8de18800bb46d2a1f59a4d437dc968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:27:27.716604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.717250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-2ece396d-473e-4a40-b39e-529d9c6eecdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:27:27.718820 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1130/2275] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:27:27 2022] DELETE /identity/v3/projects/dc8de18800bb46d2a1f59a4d437dc968 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:27.725058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd00ad-6539-41e4-ad9c-35370c49e29f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:27.725350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd00ad-6539-41e4-ad9c-35370c49e29f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:27.725625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd00ad-6539-41e4-ad9c-35370c49e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:27.743979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-17bd00ad-6539-41e4-ad9c-35370c49e29f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:27:27.745214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-17bd00ad-6539-41e4-ad9c-35370c49e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:27.803612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1146/2276] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:27:27.811050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc9b0-ecfb-400f-84e4-a5930b7e7dfa None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:27.811334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc9b0-ecfb-400f-84e4-a5930b7e7dfa None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:27.811608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc9b0-ecfb-400f-84e4-a5930b7e7dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:27.830415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-361bc9b0-ecfb-400f-84e4-a5930b7e7dfa None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:27:27.831629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-361bc9b0-ecfb-400f-84e4-a5930b7e7dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:27.839791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1131/2277] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:27:27.843942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd00ad-6539-41e4-ad9c-35370c49e29f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:27.854962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd00ad-6539-41e4-ad9c-35370c49e29f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:27.859556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef247721-8cb0-4a5b-8fde-365eb6f75f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:27.860767 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247721-8cb0-4a5b-8fde-365eb6f75f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:27.861051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247721-8cb0-4a5b-8fde-365eb6f75f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:27.861324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247721-8cb0-4a5b-8fde-365eb6f75f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:27.862045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef247721-8cb0-4a5b-8fde-365eb6f75f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:27:27.862386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef247721-8cb0-4a5b-8fde-365eb6f75f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:27.863977 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef247721-8cb0-4a5b-8fde-365eb6f75f26 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:27.876448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1147/2278] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:27:27.880764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bc9b0-ecfb-400f-84e4-a5930b7e7dfa None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:27.889895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bc9b0-ecfb-400f-84e4-a5930b7e7dfa None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:27.894723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e13f-6777-4075-b73f-1cef235370e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:27.895328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e13f-6777-4075-b73f-1cef235370e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:27.895592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e13f-6777-4075-b73f-1cef235370e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:27.895866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e13f-6777-4075-b73f-1cef235370e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:27.896568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e13f-6777-4075-b73f-1cef235370e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:27.898529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e13f-6777-4075-b73f-1cef235370e0 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:27.924057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1132/2279] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:27:27 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:27:27.928241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef247721-8cb0-4a5b-8fde-365eb6f75f26 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:27.938051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef247721-8cb0-4a5b-8fde-365eb6f75f26 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:27.997130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bf010-3895-4092-b450-4e6d14876a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:27.997797 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bf010-3895-4092-b450-4e6d14876a78 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:27.998077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bf010-3895-4092-b450-4e6d14876a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:27.998562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bf010-3895-4092-b450-4e6d14876a78 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:27.999257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bf010-3895-4092-b450-4e6d14876a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:28.001198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bf010-3895-4092-b450-4e6d14876a78 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:28.023473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1148/2280] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:27:27 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:27:28.027493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e13f-6777-4075-b73f-1cef235370e0 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:28.038096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e13f-6777-4075-b73f-1cef235370e0 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:28.043040 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d35f7a-57b0-4b5f-a4b7-67fd0882f8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:28.043710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d35f7a-57b0-4b5f-a4b7-67fd0882f8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:28.043991 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d35f7a-57b0-4b5f-a4b7-67fd0882f8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:28.044262 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d35f7a-57b0-4b5f-a4b7-67fd0882f8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:28.044988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d35f7a-57b0-4b5f-a4b7-67fd0882f8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:28.046671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d35f7a-57b0-4b5f-a4b7-67fd0882f8c6 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:28.058937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1133/2281] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:27:28.063772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bf010-3895-4092-b450-4e6d14876a78 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:28.075249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bf010-3895-4092-b450-4e6d14876a78 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:28.079844 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1d1c0-f1da-47eb-8d9c-161adcee6e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:28.080523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1d1c0-f1da-47eb-8d9c-161adcee6e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:28.080802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1d1c0-f1da-47eb-8d9c-161adcee6e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:28.081074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1d1c0-f1da-47eb-8d9c-161adcee6e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:28.081785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1d1c0-f1da-47eb-8d9c-161adcee6e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:28.083396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1d1c0-f1da-47eb-8d9c-161adcee6e7e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:28.095397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1149/2282] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:27:28.099465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d35f7a-57b0-4b5f-a4b7-67fd0882f8c6 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:28.109189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d35f7a-57b0-4b5f-a4b7-67fd0882f8c6 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:28.114470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1e730-69c0-4f6c-aae8-4b65782c0398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:28.115337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1e730-69c0-4f6c-aae8-4b65782c0398 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:28.115618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1e730-69c0-4f6c-aae8-4b65782c0398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:28.115891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1e730-69c0-4f6c-aae8-4b65782c0398 admin admin] PATH_INFO: `/v3/projects/ca04eac819504f43a24b590574548ea4/users/62b566df36d54cedb7a92ae72db40b11/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:28.129899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1e730-69c0-4f6c-aae8-4b65782c0398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca04eac819504f43a24b590574548ea4, user_id=62b566df36d54cedb7a92ae72db40b11, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:28.132574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1e730-69c0-4f6c-aae8-4b65782c0398 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:28.145257 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1134/2283] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:27:28 2022] PUT /identity/v3/projects/ca04eac819504f43a24b590574548ea4/users/62b566df36d54cedb7a92ae72db40b11/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:27:28.156267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde33c4-33fd-499d-92d3-7ae33611ce40 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:28.156605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde33c4-33fd-499d-92d3-7ae33611ce40 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:28.157376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde33c4-33fd-499d-92d3-7ae33611ce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:28.183931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-bbde33c4-33fd-499d-92d3-7ae33611ce40 None None] MFA Rules not processed for user `62b566df36d54cedb7a92ae72db40b11`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:27:28.185201 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-bbde33c4-33fd-499d-92d3-7ae33611ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:28.250044 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1150/2284] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:27:28.261479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1e730-69c0-4f6c-aae8-4b65782c0398 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:27:28.263336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b8f1e730-69c0-4f6c-aae8-4b65782c0398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:27:28.319243 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1e730-69c0-4f6c-aae8-4b65782c0398 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:27:28.322944 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14b1bd-46b5-47a3-9326-79b342b873c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9a11df2d3d4dc292a5115de69bb288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:27:28.323596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14b1bd-46b5-47a3-9326-79b342b873c5 service glance] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:27:28.323878 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14b1bd-46b5-47a3-9326-79b342b873c5 service glance] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:27:28.324156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14b1bd-46b5-47a3-9326-79b342b873c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:27:28.333368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14b1bd-46b5-47a3-9326-79b342b873c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:27:28.334838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14b1bd-46b5-47a3-9326-79b342b873c5 service glance] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:27:28.343413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1135/2285] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:27:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:28:07.010437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde33c4-33fd-499d-92d3-7ae33611ce40 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:07.011896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-bbde33c4-33fd-499d-92d3-7ae33611ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:07.105580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde33c4-33fd-499d-92d3-7ae33611ce40 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:07.111262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea4df1-2eda-40ae-913c-d0cac8846306 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35ae873d42b490cae4dd610f2ac6a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:07.111938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea4df1-2eda-40ae-913c-d0cac8846306 service placement] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:07.112241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea4df1-2eda-40ae-913c-d0cac8846306 service placement] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:07.112517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea4df1-2eda-40ae-913c-d0cac8846306 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:07.114328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-36ea4df1-2eda-40ae-913c-d0cac8846306 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:07.125345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea4df1-2eda-40ae-913c-d0cac8846306 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:07.126943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea4df1-2eda-40ae-913c-d0cac8846306 service placement] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:07.136361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1151/2286] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:28:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:28:25.314569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14b1bd-46b5-47a3-9326-79b342b873c5 service glance] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:25.376006 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14b1bd-46b5-47a3-9326-79b342b873c5 service glance] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:25.380623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:25.381535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:25.381841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:25.382182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] PATH_INFO: `/v3/users/62b566df36d54cedb7a92ae72db40b11` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:25.383646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b566df36d54cedb7a92ae72db40b11)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:25.385638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:25.429083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b566df36d54cedb7a92ae72db40b11'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:25.435616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b566df36d54cedb7a92ae72db40b11'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:25.436335 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b566df36d54cedb7a92ae72db40b11'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:25.443285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b566df36d54cedb7a92ae72db40b11'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:25.451455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c629c1-331a-4e24-a1cf-e01afcccf3c0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:25.452457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c629c1-331a-4e24-a1cf-e01afcccf3c0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:25.452774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c629c1-331a-4e24-a1cf-e01afcccf3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:25.455860 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-54db5efd-39bb-4f2b-b4eb-c6b9aaea2695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b566df36d54cedb7a92ae72db40b11'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:25.461766 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1136/2287] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:28:25 2022] DELETE /identity/v3/users/62b566df36d54cedb7a92ae72db40b11 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:28:25.466016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1710-a51b-4ca8-b131-422b4c833a33 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:25.466332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1710-a51b-4ca8-b131-422b4c833a33 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:25.466612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1710-a51b-4ca8-b131-422b4c833a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:25.471063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a8c629c1-331a-4e24-a1cf-e01afcccf3c0 None None] MFA Rules not processed for user `16fc0dcfe5c740c9a127df3a06352365`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:25.472262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a8c629c1-331a-4e24-a1cf-e01afcccf3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:25.485084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-586a1710-a51b-4ca8-b131-422b4c833a33 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:25.486328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-586a1710-a51b-4ca8-b131-422b4c833a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:25.528138 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1152/2288] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:28:25.544468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1137/2289] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:25.554593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c629c1-331a-4e24-a1cf-e01afcccf3c0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:25.556157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a8c629c1-331a-4e24-a1cf-e01afcccf3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:25.611474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c629c1-331a-4e24-a1cf-e01afcccf3c0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:25.615125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e5069-b741-4f9b-b6d4-1c26efafe232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:25.615772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e5069-b741-4f9b-b6d4-1c26efafe232 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:25.616059 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e5069-b741-4f9b-b6d4-1c26efafe232 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:25.616338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e5069-b741-4f9b-b6d4-1c26efafe232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:25.625633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e5069-b741-4f9b-b6d4-1c26efafe232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:25.627079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e5069-b741-4f9b-b6d4-1c26efafe232 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:25.636288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1153/2290] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:28:25.918041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a1710-a51b-4ca8-b131-422b4c833a33 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:25.919702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-586a1710-a51b-4ca8-b131-422b4c833a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:25.946014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a1710-a51b-4ca8-b131-422b4c833a33 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:25.951438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:25.952940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:25.953288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:25.954287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] PATH_INFO: `/v3/projects/ca04eac819504f43a24b590574548ea4` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:25.955591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca04eac819504f43a24b590574548ea4)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:25.957704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:26.012920 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca04eac819504f43a24b590574548ea4', 'request_id': 'req-0310f4d5-5a0a-42be-8550-f5a27c73198a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:26.020269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca04eac819504f43a24b590574548ea4', 'request_id': 'req-0310f4d5-5a0a-42be-8550-f5a27c73198a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:26.027840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca04eac819504f43a24b590574548ea4', 'request_id': 'req-0310f4d5-5a0a-42be-8550-f5a27c73198a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:26.039791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] The token cache is being invalidate because project ca04eac819504f43a24b590574548ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:28:26.040385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:26.041052 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-0310f4d5-5a0a-42be-8550-f5a27c73198a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:26.042662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1138/2291] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:28:25 2022] DELETE /identity/v3/projects/ca04eac819504f43a24b590574548ea4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:28:26.048870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c707e-b4a5-41c1-bfed-db1b22c8ec60 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.049169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c707e-b4a5-41c1-bfed-db1b22c8ec60 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.049456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c707e-b4a5-41c1-bfed-db1b22c8ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.068140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f84c707e-b4a5-41c1-bfed-db1b22c8ec60 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:26.069406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f84c707e-b4a5-41c1-bfed-db1b22c8ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:26.131252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1154/2292] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:26.139054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa8d1c-4ae2-461d-aee2-d0536df62cb5 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.139429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa8d1c-4ae2-461d-aee2-d0536df62cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.139776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa8d1c-4ae2-461d-aee2-d0536df62cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.158635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-47aa8d1c-4ae2-461d-aee2-d0536df62cb5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:26.159849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-47aa8d1c-4ae2-461d-aee2-d0536df62cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:26.167764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1139/2293] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:26.172564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c707e-b4a5-41c1-bfed-db1b22c8ec60 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:26.182760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c707e-b4a5-41c1-bfed-db1b22c8ec60 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:26.188083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b333b6-fb58-4d0c-90c5-a9e2a444a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:26.188802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b333b6-fb58-4d0c-90c5-a9e2a444a77d admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.189086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b333b6-fb58-4d0c-90c5-a9e2a444a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.189388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b333b6-fb58-4d0c-90c5-a9e2a444a77d admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.190182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b333b6-fb58-4d0c-90c5-a9e2a444a77d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:28:26.190493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b333b6-fb58-4d0c-90c5-a9e2a444a77d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:26.192130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b333b6-fb58-4d0c-90c5-a9e2a444a77d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:26.204148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1155/2294] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:28:26.208458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa8d1c-4ae2-461d-aee2-d0536df62cb5 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:26.219217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa8d1c-4ae2-461d-aee2-d0536df62cb5 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:26.226506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4909b0-8089-4caf-8c2e-05f654be4fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:26.227812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4909b0-8089-4caf-8c2e-05f654be4fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.227812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4909b0-8089-4caf-8c2e-05f654be4fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.228009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4909b0-8089-4caf-8c2e-05f654be4fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.228668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4909b0-8089-4caf-8c2e-05f654be4fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:26.236307 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4909b0-8089-4caf-8c2e-05f654be4fd1 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:26.264152 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1140/2295] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:28:26 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:28:26.268148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b333b6-fb58-4d0c-90c5-a9e2a444a77d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:26.278730 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b333b6-fb58-4d0c-90c5-a9e2a444a77d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:26.355642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93400b1d-58c2-42b2-a020-2b74f2042e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:26.355642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93400b1d-58c2-42b2-a020-2b74f2042e28 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.355642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93400b1d-58c2-42b2-a020-2b74f2042e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.355642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93400b1d-58c2-42b2-a020-2b74f2042e28 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.356256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93400b1d-58c2-42b2-a020-2b74f2042e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:26.358282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93400b1d-58c2-42b2-a020-2b74f2042e28 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:26.380271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1156/2296] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:28:26 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:28:26.384662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4909b0-8089-4caf-8c2e-05f654be4fd1 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:26.395966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4909b0-8089-4caf-8c2e-05f654be4fd1 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:26.427217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e763e-7e38-40bf-8d7c-8d1abffb8e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:26.427578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e763e-7e38-40bf-8d7c-8d1abffb8e39 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.427929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e763e-7e38-40bf-8d7c-8d1abffb8e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.428271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e763e-7e38-40bf-8d7c-8d1abffb8e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.429239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e763e-7e38-40bf-8d7c-8d1abffb8e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:26.431086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e763e-7e38-40bf-8d7c-8d1abffb8e39 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:26.444197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1141/2297] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:28:26.447888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93400b1d-58c2-42b2-a020-2b74f2042e28 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:26.462615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93400b1d-58c2-42b2-a020-2b74f2042e28 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:26.475637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da02ad7-a33b-43f4-8537-101ff5f75551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:26.476990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da02ad7-a33b-43f4-8537-101ff5f75551 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.476990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da02ad7-a33b-43f4-8537-101ff5f75551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.477205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da02ad7-a33b-43f4-8537-101ff5f75551 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.477890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da02ad7-a33b-43f4-8537-101ff5f75551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:26.479623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da02ad7-a33b-43f4-8537-101ff5f75551 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:26.490587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1157/2298] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:28:26.495329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e763e-7e38-40bf-8d7c-8d1abffb8e39 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:26.507106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e763e-7e38-40bf-8d7c-8d1abffb8e39 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:26.511753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471ca4f-8101-4d71-85bc-6d8af3639754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:26.512657 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471ca4f-8101-4d71-85bc-6d8af3639754 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.512938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471ca4f-8101-4d71-85bc-6d8af3639754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.513210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471ca4f-8101-4d71-85bc-6d8af3639754 admin admin] PATH_INFO: `/v3/projects/3619586da6be4da88a4497552d6d0b1d/users/f9a07b3e1aea48cb9d74cdc49bafbd09/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.529297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471ca4f-8101-4d71-85bc-6d8af3639754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3619586da6be4da88a4497552d6d0b1d, user_id=f9a07b3e1aea48cb9d74cdc49bafbd09, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:26.532355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471ca4f-8101-4d71-85bc-6d8af3639754 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:26.546341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1142/2299] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:28:26 2022] PUT /identity/v3/projects/3619586da6be4da88a4497552d6d0b1d/users/f9a07b3e1aea48cb9d74cdc49bafbd09/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:28:26.557414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834d14-f864-479d-b498-a6439532a99e None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.557761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834d14-f864-479d-b498-a6439532a99e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.557979 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834d14-f864-479d-b498-a6439532a99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.591480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8c834d14-f864-479d-b498-a6439532a99e None None] MFA Rules not processed for user `f9a07b3e1aea48cb9d74cdc49bafbd09`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:26.592781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8c834d14-f864-479d-b498-a6439532a99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:26.696895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1158/2300] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:26.709371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471ca4f-8101-4d71-85bc-6d8af3639754 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:26.711162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9471ca4f-8101-4d71-85bc-6d8af3639754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:26.820100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471ca4f-8101-4d71-85bc-6d8af3639754 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:26.824219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a902ed-7a49-4673-9be0-81b6c6d246d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:26.824883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a902ed-7a49-4673-9be0-81b6c6d246d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:26.825292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a902ed-7a49-4673-9be0-81b6c6d246d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:26.825538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a902ed-7a49-4673-9be0-81b6c6d246d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:26.835623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a902ed-7a49-4673-9be0-81b6c6d246d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:26.837044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a902ed-7a49-4673-9be0-81b6c6d246d8 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:26.846233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1143/2301] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:28:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:28:28.217650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9c73-416e-4e3b-94ed-32402ceca818 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:28.219300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9c73-416e-4e3b-94ed-32402ceca818 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:28.219585 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9c73-416e-4e3b-94ed-32402ceca818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:28.243881 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-bbab9c73-416e-4e3b-94ed-32402ceca818 None None] MFA Rules not processed for user `f9a07b3e1aea48cb9d74cdc49bafbd09`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:28.245102 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-bbab9c73-416e-4e3b-94ed-32402ceca818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:28.252984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1159/2302] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:28:33.495737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a902ed-7a49-4673-9be0-81b6c6d246d8 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:33.497290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-82a902ed-7a49-4673-9be0-81b6c6d246d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:33.610898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a902ed-7a49-4673-9be0-81b6c6d246d8 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:33.616420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:33.617308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:33.617588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:33.617858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] PATH_INFO: `/v3/users/8fe99bd37b184bf3b5e78602ab0073fe` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:33.619185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe99bd37b184bf3b5e78602ab0073fe)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:33.621962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:33.684952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe99bd37b184bf3b5e78602ab0073fe'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:33.698353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe99bd37b184bf3b5e78602ab0073fe'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:33.699140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe99bd37b184bf3b5e78602ab0073fe'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:33.708380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe99bd37b184bf3b5e78602ab0073fe'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:33.727014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-99e519ec-69f1-4c6f-93df-d3b0f6a49464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe99bd37b184bf3b5e78602ab0073fe'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:33.742887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1144/2303] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:28:33 2022] DELETE /identity/v3/users/8fe99bd37b184bf3b5e78602ab0073fe => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:28:33.942976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab9c73-416e-4e3b-94ed-32402ceca818 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:33.960516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab9c73-416e-4e3b-94ed-32402ceca818 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:34.063282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:34.064288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.064641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.064990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] PATH_INFO: `/v3/projects/af4cd71eec7c4d47a9d7e9cdd65add9a` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.066566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4cd71eec7c4d47a9d7e9cdd65add9a)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:34.068573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:34.124337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4cd71eec7c4d47a9d7e9cdd65add9a', 'request_id': 'req-c01f271e-3859-4ba3-9fbf-e7794d1e5689'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:34.132366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4cd71eec7c4d47a9d7e9cdd65add9a', 'request_id': 'req-c01f271e-3859-4ba3-9fbf-e7794d1e5689'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:34.139689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4cd71eec7c4d47a9d7e9cdd65add9a', 'request_id': 'req-c01f271e-3859-4ba3-9fbf-e7794d1e5689'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:34.150197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] The token cache is being invalidate because project af4cd71eec7c4d47a9d7e9cdd65add9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:28:34.150493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:34.151143 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c01f271e-3859-4ba3-9fbf-e7794d1e5689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:34.152664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1160/2304] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:28:33 2022] DELETE /identity/v3/projects/af4cd71eec7c4d47a9d7e9cdd65add9a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:28:34.157996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649549-bf10-44e4-8fc5-57cc93e9b373 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.158313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649549-bf10-44e4-8fc5-57cc93e9b373 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.158590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649549-bf10-44e4-8fc5-57cc93e9b373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.177731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-5f649549-bf10-44e4-8fc5-57cc93e9b373 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:34.178957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5f649549-bf10-44e4-8fc5-57cc93e9b373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:34.254438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1145/2305] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:34.262165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c687e-c481-4dcf-bde1-773bf6804750 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.262539 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c687e-c481-4dcf-bde1-773bf6804750 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.262907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c687e-c481-4dcf-bde1-773bf6804750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.282884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-160c687e-c481-4dcf-bde1-773bf6804750 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:34.284464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-160c687e-c481-4dcf-bde1-773bf6804750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:34.295273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1161/2306] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:34.299628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f649549-bf10-44e4-8fc5-57cc93e9b373 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:34.309380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f649549-bf10-44e4-8fc5-57cc93e9b373 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:34.316523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776f0c-0983-479d-94a4-84105c91ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:34.317251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776f0c-0983-479d-94a4-84105c91ea89 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.317599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776f0c-0983-479d-94a4-84105c91ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.317936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776f0c-0983-479d-94a4-84105c91ea89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.318771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776f0c-0983-479d-94a4-84105c91ea89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:28:34.319078 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776f0c-0983-479d-94a4-84105c91ea89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:34.320692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776f0c-0983-479d-94a4-84105c91ea89 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:34.337587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1146/2307] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:28:34.341804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c687e-c481-4dcf-bde1-773bf6804750 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:34.350953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c687e-c481-4dcf-bde1-773bf6804750 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:34.355608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30214742-83bb-42c1-8ca8-88cedf079e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:34.356272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30214742-83bb-42c1-8ca8-88cedf079e36 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.356556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30214742-83bb-42c1-8ca8-88cedf079e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.356833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30214742-83bb-42c1-8ca8-88cedf079e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.358069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30214742-83bb-42c1-8ca8-88cedf079e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:34.359999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30214742-83bb-42c1-8ca8-88cedf079e36 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:34.386212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1162/2308] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:28:34 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:28:34.390406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776f0c-0983-479d-94a4-84105c91ea89 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:34.400225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776f0c-0983-479d-94a4-84105c91ea89 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:34.462847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24736db-89b5-437d-b735-8086535903a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:34.463468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24736db-89b5-437d-b735-8086535903a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.463759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24736db-89b5-437d-b735-8086535903a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.464033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24736db-89b5-437d-b735-8086535903a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.464725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24736db-89b5-437d-b735-8086535903a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:34.466723 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24736db-89b5-437d-b735-8086535903a9 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:34.489090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1147/2309] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:28:34 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:28:34.490589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30214742-83bb-42c1-8ca8-88cedf079e36 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:34.501383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30214742-83bb-42c1-8ca8-88cedf079e36 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:34.506030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db72885-e1f0-4d7f-a440-cad9d1ee6b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:34.506728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db72885-e1f0-4d7f-a440-cad9d1ee6b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.507028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db72885-e1f0-4d7f-a440-cad9d1ee6b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.507274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db72885-e1f0-4d7f-a440-cad9d1ee6b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.507999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db72885-e1f0-4d7f-a440-cad9d1ee6b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:34.509572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db72885-e1f0-4d7f-a440-cad9d1ee6b77 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:34.520136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1163/2310] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:28:34.524759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24736db-89b5-437d-b735-8086535903a9 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:34.535625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24736db-89b5-437d-b735-8086535903a9 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:34.540236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecead6a-792b-4aa9-81ed-c38d53a5f0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:34.540883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecead6a-792b-4aa9-81ed-c38d53a5f0bb admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.541162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecead6a-792b-4aa9-81ed-c38d53a5f0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.541432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecead6a-792b-4aa9-81ed-c38d53a5f0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.542173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecead6a-792b-4aa9-81ed-c38d53a5f0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:34.543800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecead6a-792b-4aa9-81ed-c38d53a5f0bb admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:34.554192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1148/2311] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:28:34.558276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db72885-e1f0-4d7f-a440-cad9d1ee6b77 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:34.568779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db72885-e1f0-4d7f-a440-cad9d1ee6b77 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:34.573489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c23f-860a-4cf8-97e3-f7bdbd1f738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:34.574397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c23f-860a-4cf8-97e3-f7bdbd1f738c admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.574681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c23f-860a-4cf8-97e3-f7bdbd1f738c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.574955 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c23f-860a-4cf8-97e3-f7bdbd1f738c admin admin] PATH_INFO: `/v3/projects/44e141ba2afe439c88dacb1c3939d477/users/d791b80cee0d494c9a307e6293f68679/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.589484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944c23f-860a-4cf8-97e3-f7bdbd1f738c admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e141ba2afe439c88dacb1c3939d477, user_id=d791b80cee0d494c9a307e6293f68679, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:34.592190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944c23f-860a-4cf8-97e3-f7bdbd1f738c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:34.606969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1164/2312] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:28:34 2022] PUT /identity/v3/projects/44e141ba2afe439c88dacb1c3939d477/users/d791b80cee0d494c9a307e6293f68679/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:28:34.624191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325945a4-55b2-45f7-8bd3-cff41d4b5a38 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.624568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325945a4-55b2-45f7-8bd3-cff41d4b5a38 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.625093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325945a4-55b2-45f7-8bd3-cff41d4b5a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.652337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-325945a4-55b2-45f7-8bd3-cff41d4b5a38 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:34.653981 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-325945a4-55b2-45f7-8bd3-cff41d4b5a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:34.713332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1149/2313] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:34.723554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c23f-860a-4cf8-97e3-f7bdbd1f738c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:34.725222 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0944c23f-860a-4cf8-97e3-f7bdbd1f738c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:34.780512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c23f-860a-4cf8-97e3-f7bdbd1f738c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:34.784135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0e025-a6ad-4ef3-b2b7-55b0b97d1285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:34.784786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0e025-a6ad-4ef3-b2b7-55b0b97d1285 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:34.785069 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0e025-a6ad-4ef3-b2b7-55b0b97d1285 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:34.785345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0e025-a6ad-4ef3-b2b7-55b0b97d1285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:34.794254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0e025-a6ad-4ef3-b2b7-55b0b97d1285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:34.796229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0e025-a6ad-4ef3-b2b7-55b0b97d1285 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:34.805498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1165/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:28:39.412929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4d95-487f-4099-8ddf-3b84eaa5461f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:39.413424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4d95-487f-4099-8ddf-3b84eaa5461f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:39.413518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4d95-487f-4099-8ddf-3b84eaa5461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:39.437051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-aaac4d95-487f-4099-8ddf-3b84eaa5461f None None] MFA Rules not processed for user `719425608bc4447ea2f433e12ebbb180`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:39.439003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-aaac4d95-487f-4099-8ddf-3b84eaa5461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:39.534339 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1150/2315] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:40.120978 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae508c-ad7e-4087-b66a-33cdbbf580bb None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:40.121470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae508c-ad7e-4087-b66a-33cdbbf580bb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:40.121552 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae508c-ad7e-4087-b66a-33cdbbf580bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:40.165533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-acae508c-ad7e-4087-b66a-33cdbbf580bb None None] MFA Rules not processed for user `d791b80cee0d494c9a307e6293f68679`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:40.166802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-acae508c-ad7e-4087-b66a-33cdbbf580bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:40.247105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1166/2316] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:40.555352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac4d95-487f-4099-8ddf-3b84eaa5461f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:40.556855 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-aaac4d95-487f-4099-8ddf-3b84eaa5461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:40.699039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac4d95-487f-4099-8ddf-3b84eaa5461f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:40.707384 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62440a-a32c-4430-a0eb-1504e6447fd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:40.708331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62440a-a32c-4430-a0eb-1504e6447fd8 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:40.708800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62440a-a32c-4430-a0eb-1504e6447fd8 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:40.709200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62440a-a32c-4430-a0eb-1504e6447fd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:40.720047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62440a-a32c-4430-a0eb-1504e6447fd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:40.721380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62440a-a32c-4430-a0eb-1504e6447fd8 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:40.736066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1151/2317] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:28:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:28:42.983398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9120e-31c8-49d4-b298-c065fe6249b4 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:42.984646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9120e-31c8-49d4-b298-c065fe6249b4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:42.985180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9120e-31c8-49d4-b298-c065fe6249b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:43.039121 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d4a9120e-31c8-49d4-b298-c065fe6249b4 None None] MFA Rules not processed for user `d791b80cee0d494c9a307e6293f68679`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:43.040379 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d4a9120e-31c8-49d4-b298-c065fe6249b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:43.071736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1167/2318] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:51.181842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31031ca-afaa-46d3-9409-4b767d3a72f2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:51.182350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31031ca-afaa-46d3-9409-4b767d3a72f2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:51.182566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31031ca-afaa-46d3-9409-4b767d3a72f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:51.230460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e31031ca-afaa-46d3-9409-4b767d3a72f2 None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:51.231669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e31031ca-afaa-46d3-9409-4b767d3a72f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:51.297514 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1152/2319] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:28:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:51.347272 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9120e-31c8-49d4-b298-c065fe6249b4 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:51.349208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d4a9120e-31c8-49d4-b298-c065fe6249b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:51.441434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9120e-31c8-49d4-b298-c065fe6249b4 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:51.446936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891213b-f707-4418-8aec-bd55475ce533 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:51.447785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891213b-f707-4418-8aec-bd55475ce533 service swift] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:51.448079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891213b-f707-4418-8aec-bd55475ce533 service swift] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:51.448366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891213b-f707-4418-8aec-bd55475ce533 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:51.457629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891213b-f707-4418-8aec-bd55475ce533 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:51.459227 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891213b-f707-4418-8aec-bd55475ce533 service swift] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:51.467603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1168/2320] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:28:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:28:51.980055 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0009d94-6728-4dc2-b314-11959e332d8b None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:51.980346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0009d94-6728-4dc2-b314-11959e332d8b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:51.980626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0009d94-6728-4dc2-b314-11959e332d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:51.998463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a0009d94-6728-4dc2-b314-11959e332d8b None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:51.999638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a0009d94-6728-4dc2-b314-11959e332d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:52.006615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1153/2321] 10.222.0.16 () {58 vars in 967 bytes} [Thu Mar 10 17:28:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:52.018596 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891213b-f707-4418-8aec-bd55475ce533 service swift] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:52.029416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891213b-f707-4418-8aec-bd55475ce533 service swift] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:52.034405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b85c-6835-44b2-99c7-1016f2f59db8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:52.035031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b85c-6835-44b2-99c7-1016f2f59db8 service swift] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:52.035309 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b85c-6835-44b2-99c7-1016f2f59db8 service swift] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:52.035581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b85c-6835-44b2-99c7-1016f2f59db8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:52.043394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087b85c-6835-44b2-99c7-1016f2f59db8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:52.045531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087b85c-6835-44b2-99c7-1016f2f59db8 service swift] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:52.053254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1169/2322] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:28:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:28:52.238299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb40faa-4eec-473b-8238-f04e55ce4151 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:52.238781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb40faa-4eec-473b-8238-f04e55ce4151 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:52.239068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb40faa-4eec-473b-8238-f04e55ce4151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:52.257595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bcb40faa-4eec-473b-8238-f04e55ce4151 None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:52.259033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bcb40faa-4eec-473b-8238-f04e55ce4151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:52.266075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1154/2323] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:28:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:52.278028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b85c-6835-44b2-99c7-1016f2f59db8 service swift] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:52.289038 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b85c-6835-44b2-99c7-1016f2f59db8 service swift] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:52.296412 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bb79a-285a-4172-80bb-df56c5f88294 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:52.297066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb79a-285a-4172-80bb-df56c5f88294 service swift] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:52.297357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb79a-285a-4172-80bb-df56c5f88294 service swift] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:52.297640 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb79a-285a-4172-80bb-df56c5f88294 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:52.306434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb79a-285a-4172-80bb-df56c5f88294 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:52.308078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb79a-285a-4172-80bb-df56c5f88294 service swift] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:52.316823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1170/2324] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:28:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 10 17:28:52.669957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d381-3465-4c12-80df-f44516f50428 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:52.670278 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d381-3465-4c12-80df-f44516f50428 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:52.670553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d381-3465-4c12-80df-f44516f50428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:52.688431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e488d381-3465-4c12-80df-f44516f50428 None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:52.689629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e488d381-3465-4c12-80df-f44516f50428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:52.698350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1155/2325] 10.222.0.16 () {58 vars in 967 bytes} [Thu Mar 10 17:28:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:52.712924 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bb79a-285a-4172-80bb-df56c5f88294 service swift] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:52.723894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bb79a-285a-4172-80bb-df56c5f88294 service swift] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:52.728995 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5beae-108d-4259-892e-06efd506818e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:52.729636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5beae-108d-4259-892e-06efd506818e service swift] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:52.729919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5beae-108d-4259-892e-06efd506818e service swift] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:52.730246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5beae-108d-4259-892e-06efd506818e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:52.738852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5beae-108d-4259-892e-06efd506818e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:52.740465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5beae-108d-4259-892e-06efd506818e service swift] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:52.749661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1171/2326] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:28:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:28:54.880932 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d381-3465-4c12-80df-f44516f50428 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:54.882357 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e488d381-3465-4c12-80df-f44516f50428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:54.898463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d381-3465-4c12-80df-f44516f50428 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:54.903219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:54.905263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:54.905469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:54.905706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] PATH_INFO: `/v3/users/f9a07b3e1aea48cb9d74cdc49bafbd09` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:54.907143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a07b3e1aea48cb9d74cdc49bafbd09)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:54.909057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:54.955964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a07b3e1aea48cb9d74cdc49bafbd09'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:54.963251 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a07b3e1aea48cb9d74cdc49bafbd09'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:54.963958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a07b3e1aea48cb9d74cdc49bafbd09'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:54.971792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a07b3e1aea48cb9d74cdc49bafbd09'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:54.987953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a07b3e1aea48cb9d74cdc49bafbd09'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:54.993721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1156/2327] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:28:54 2022] DELETE /identity/v3/users/f9a07b3e1aea48cb9d74cdc49bafbd09 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:28:54.998679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b4621-a507-4eeb-8b92-f36550745abe None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:54.999132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b4621-a507-4eeb-8b92-f36550745abe None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:54.999250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b4621-a507-4eeb-8b92-f36550745abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.017133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-af9b4621-a507-4eeb-8b92-f36550745abe None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:55.018383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-af9b4621-a507-4eeb-8b92-f36550745abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:55.073956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1172/2328] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:28:55.083985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:55.085352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:55.139925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a33fd-491a-4c1e-bb42-2565c40a9d17 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:55.143706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524a492-17ce-4ba3-898f-339147e14a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:55.144339 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a492-17ce-4ba3-898f-339147e14a80 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.144619 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a492-17ce-4ba3-898f-339147e14a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.144898 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a492-17ce-4ba3-898f-339147e14a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.154461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a492-17ce-4ba3-898f-339147e14a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:55.155962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a492-17ce-4ba3-898f-339147e14a80 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:55.165266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1157/2329] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:28:55.399941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b4621-a507-4eeb-8b92-f36550745abe None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:55.401725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-af9b4621-a507-4eeb-8b92-f36550745abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:55.417422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b4621-a507-4eeb-8b92-f36550745abe None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:55.422603 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:55.423469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.423901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.424020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] PATH_INFO: `/v3/projects/3619586da6be4da88a4497552d6d0b1d` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.425200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3619586da6be4da88a4497552d6d0b1d)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:55.427333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:55.474513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3619586da6be4da88a4497552d6d0b1d', 'request_id': 'req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:55.481396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3619586da6be4da88a4497552d6d0b1d', 'request_id': 'req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:55.487928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3619586da6be4da88a4497552d6d0b1d', 'request_id': 'req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:55.498307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] The token cache is being invalidate because project 3619586da6be4da88a4497552d6d0b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:28:55.498589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:55.499214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0ab0306d-51bd-45ec-b7e0-1ee115dfa65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:28:55.500714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1173/2330] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:28:55 2022] DELETE /identity/v3/projects/3619586da6be4da88a4497552d6d0b1d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:28:55.506021 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e1e27-fb83-4887-88b1-f61f8ea39538 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.506407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e1e27-fb83-4887-88b1-f61f8ea39538 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.506683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e1e27-fb83-4887-88b1-f61f8ea39538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.524274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-7d8e1e27-fb83-4887-88b1-f61f8ea39538 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:55.525450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7d8e1e27-fb83-4887-88b1-f61f8ea39538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:55.580943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1158/2331] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:55.588841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b4dcd-56cd-49c6-8621-85e6ba6fbcad None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.589079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b4dcd-56cd-49c6-8621-85e6ba6fbcad None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.589359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b4dcd-56cd-49c6-8621-85e6ba6fbcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.608270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-764b4dcd-56cd-49c6-8621-85e6ba6fbcad None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:55.609461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-764b4dcd-56cd-49c6-8621-85e6ba6fbcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:55.617215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1174/2332] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:28:55.621296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e1e27-fb83-4887-88b1-f61f8ea39538 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:55.631306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e1e27-fb83-4887-88b1-f61f8ea39538 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:55.635896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa609f-24f0-4014-a40b-b3b14df46a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:55.636538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa609f-24f0-4014-a40b-b3b14df46a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.636822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa609f-24f0-4014-a40b-b3b14df46a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.637100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa609f-24f0-4014-a40b-b3b14df46a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.637823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa609f-24f0-4014-a40b-b3b14df46a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:28:55.638159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa609f-24f0-4014-a40b-b3b14df46a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:55.639756 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa609f-24f0-4014-a40b-b3b14df46a86 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:55.650813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1159/2333] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:28:55.655175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b4dcd-56cd-49c6-8621-85e6ba6fbcad None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:55.664125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b4dcd-56cd-49c6-8621-85e6ba6fbcad None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:55.668737 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c6c2c-fa92-424a-a0a8-14c0b50e7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:55.669877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c6c2c-fa92-424a-a0a8-14c0b50e7cce admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.670195 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c6c2c-fa92-424a-a0a8-14c0b50e7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.670478 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c6c2c-fa92-424a-a0a8-14c0b50e7cce admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.671159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c6c2c-fa92-424a-a0a8-14c0b50e7cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:55.673047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c6c2c-fa92-424a-a0a8-14c0b50e7cce admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:55.697569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1175/2334] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:28:55 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:28:55.701683 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa609f-24f0-4014-a40b-b3b14df46a86 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:55.711425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa609f-24f0-4014-a40b-b3b14df46a86 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:55.765844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3549-0a20-4b42-aa41-c972a1975844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:55.766557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3549-0a20-4b42-aa41-c972a1975844 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.766842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3549-0a20-4b42-aa41-c972a1975844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.767229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3549-0a20-4b42-aa41-c972a1975844 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.768157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a3549-0a20-4b42-aa41-c972a1975844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:55.770220 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a3549-0a20-4b42-aa41-c972a1975844 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:55.792026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1160/2335] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:28:55 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:28:55.796714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c6c2c-fa92-424a-a0a8-14c0b50e7cce admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:55.806961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c6c2c-fa92-424a-a0a8-14c0b50e7cce admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:55.811602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9390-aca5-43e9-8026-3e9b43ad3873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:55.812270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9390-aca5-43e9-8026-3e9b43ad3873 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.812563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9390-aca5-43e9-8026-3e9b43ad3873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.812842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9390-aca5-43e9-8026-3e9b43ad3873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.813563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb9390-aca5-43e9-8026-3e9b43ad3873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:55.815192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb9390-aca5-43e9-8026-3e9b43ad3873 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:55.825592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1176/2336] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:28:55.829477 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3549-0a20-4b42-aa41-c972a1975844 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:55.839736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3549-0a20-4b42-aa41-c972a1975844 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:55.845050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91aaca-d0e7-4827-9b8a-f5bff483e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:55.845714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91aaca-d0e7-4827-9b8a-f5bff483e443 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.846026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91aaca-d0e7-4827-9b8a-f5bff483e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.846369 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91aaca-d0e7-4827-9b8a-f5bff483e443 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.847210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91aaca-d0e7-4827-9b8a-f5bff483e443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:55.848893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91aaca-d0e7-4827-9b8a-f5bff483e443 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:55.859017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1161/2337] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:28:55.863159 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9390-aca5-43e9-8026-3e9b43ad3873 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:55.874086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9390-aca5-43e9-8026-3e9b43ad3873 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:55.878777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88116b5-32e2-487d-829d-6c1187af3e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:55.879669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88116b5-32e2-487d-829d-6c1187af3e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.879954 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88116b5-32e2-487d-829d-6c1187af3e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.880232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88116b5-32e2-487d-829d-6c1187af3e09 admin admin] PATH_INFO: `/v3/projects/f4dba5966a74456cb57fc9ad46e00bfe/users/78bb6c03eb73430d9d208839a8fecf52/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.894933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88116b5-32e2-487d-829d-6c1187af3e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4dba5966a74456cb57fc9ad46e00bfe, user_id=78bb6c03eb73430d9d208839a8fecf52, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:55.897543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88116b5-32e2-487d-829d-6c1187af3e09 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:55.910922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1177/2338] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:28:55 2022] PUT /identity/v3/projects/f4dba5966a74456cb57fc9ad46e00bfe/users/78bb6c03eb73430d9d208839a8fecf52/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:28:55.915881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d321-ef7b-4414-8829-454ed6412e3f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:55.916286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d321-ef7b-4414-8829-454ed6412e3f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:55.916499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d321-ef7b-4414-8829-454ed6412e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:55.934363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-dac0d321-ef7b-4414-8829-454ed6412e3f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:28:55.936061 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-dac0d321-ef7b-4414-8829-454ed6412e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:55.993116 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1162/2339] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:28:56.007300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88116b5-32e2-487d-829d-6c1187af3e09 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:28:56.008997 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a88116b5-32e2-487d-829d-6c1187af3e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:28:56.065934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88116b5-32e2-487d-829d-6c1187af3e09 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:28:56.069642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a23cb3-a8ec-4f68-b906-2b17b71c4efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:28:56.070328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23cb3-a8ec-4f68-b906-2b17b71c4efa service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:28:56.070618 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23cb3-a8ec-4f68-b906-2b17b71c4efa service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:28:56.070898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23cb3-a8ec-4f68-b906-2b17b71c4efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:28:56.080764 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a23cb3-a8ec-4f68-b906-2b17b71c4efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:28:56.082270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a23cb3-a8ec-4f68-b906-2b17b71c4efa service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:28:56.091810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1178/2340] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:29:00.473847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9c89-2201-46c2-b774-9883ca577c5c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:00.474832 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9c89-2201-46c2-b774-9883ca577c5c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:00.475113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9c89-2201-46c2-b774-9883ca577c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:00.506176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-79ce9c89-2201-46c2-b774-9883ca577c5c None None] MFA Rules not processed for user `78bb6c03eb73430d9d208839a8fecf52`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:00.507432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-79ce9c89-2201-46c2-b774-9883ca577c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:00.571814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1163/2341] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:29:00.576687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a23cb3-a8ec-4f68-b906-2b17b71c4efa service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:00.586579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a23cb3-a8ec-4f68-b906-2b17b71c4efa service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:00.592129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7837a7-a1f6-40af-8e99-646c313feb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:00.592906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7837a7-a1f6-40af-8e99-646c313feb5a admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:00.593473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7837a7-a1f6-40af-8e99-646c313feb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:00.593978 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7837a7-a1f6-40af-8e99-646c313feb5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:00.595033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7837a7-a1f6-40af-8e99-646c313feb5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:00.597431 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7837a7-a1f6-40af-8e99-646c313feb5a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:00.630082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1179/2342] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:29:00 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:29:00.634382 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce9c89-2201-46c2-b774-9883ca577c5c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:00.647946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce9c89-2201-46c2-b774-9883ca577c5c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:00.718196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f93f6f-8ef0-4c1e-8188-10bbca2e44f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:00.719323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f93f6f-8ef0-4c1e-8188-10bbca2e44f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:00.719676 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f93f6f-8ef0-4c1e-8188-10bbca2e44f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:00.720027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f93f6f-8ef0-4c1e-8188-10bbca2e44f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:00.720793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f93f6f-8ef0-4c1e-8188-10bbca2e44f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:00.722986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f93f6f-8ef0-4c1e-8188-10bbca2e44f8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:00.744182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1164/2343] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:29:00 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:29:00.748509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7837a7-a1f6-40af-8e99-646c313feb5a admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:00.761728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7837a7-a1f6-40af-8e99-646c313feb5a admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:00.767648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95e3f7-c305-4f41-9b1f-1e8abc7172fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:00.771923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95e3f7-c305-4f41-9b1f-1e8abc7172fe admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:00.772438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95e3f7-c305-4f41-9b1f-1e8abc7172fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:00.772827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95e3f7-c305-4f41-9b1f-1e8abc7172fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:00.773672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95e3f7-c305-4f41-9b1f-1e8abc7172fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:00.775448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95e3f7-c305-4f41-9b1f-1e8abc7172fe admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:00.792586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1180/2344] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:29:00.793378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f93f6f-8ef0-4c1e-8188-10bbca2e44f8 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:00.815620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f93f6f-8ef0-4c1e-8188-10bbca2e44f8 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:00.837052 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0b407-83bb-4f8d-a30c-3a0688be8392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:00.838175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0b407-83bb-4f8d-a30c-3a0688be8392 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:00.838626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0b407-83bb-4f8d-a30c-3a0688be8392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:00.839495 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0b407-83bb-4f8d-a30c-3a0688be8392 admin admin] PATH_INFO: `/v3/projects/4cf861ead6d04331934a91210b174459/users/597d891898a44b7b8c1cc426ba42ee3a/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:00.863607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0b407-83bb-4f8d-a30c-3a0688be8392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf861ead6d04331934a91210b174459, user_id=597d891898a44b7b8c1cc426ba42ee3a, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:00.866674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0b407-83bb-4f8d-a30c-3a0688be8392 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:00.894699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1165/2345] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:29:00 2022] PUT /identity/v3/projects/4cf861ead6d04331934a91210b174459/users/597d891898a44b7b8c1cc426ba42ee3a/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:29:00.898788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95e3f7-c305-4f41-9b1f-1e8abc7172fe admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:00.912899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95e3f7-c305-4f41-9b1f-1e8abc7172fe admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:00.982726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666ab5e-e5da-4051-929a-a0fe79039265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:00.983571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666ab5e-e5da-4051-929a-a0fe79039265 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:00.983867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666ab5e-e5da-4051-929a-a0fe79039265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:00.984149 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666ab5e-e5da-4051-929a-a0fe79039265 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:00.984880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666ab5e-e5da-4051-929a-a0fe79039265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:00.986913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666ab5e-e5da-4051-929a-a0fe79039265 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:01.000476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1181/2346] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:29:01.004622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0b407-83bb-4f8d-a30c-3a0688be8392 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:01.015924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0b407-83bb-4f8d-a30c-3a0688be8392 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:01.022564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eeeb72-415b-483b-9807-2e7c0a78c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:01.023462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eeeb72-415b-483b-9807-2e7c0a78c34e admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:01.023893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eeeb72-415b-483b-9807-2e7c0a78c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:01.024178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eeeb72-415b-483b-9807-2e7c0a78c34e admin admin] PATH_INFO: `/v3/projects/4cf861ead6d04331934a91210b174459/users/597d891898a44b7b8c1cc426ba42ee3a/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:01.026386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eeeb72-415b-483b-9807-2e7c0a78c34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf861ead6d04331934a91210b174459, user_id=597d891898a44b7b8c1cc426ba42ee3a, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:01.029722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eeeb72-415b-483b-9807-2e7c0a78c34e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:01.040880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1166/2347] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:29:01 2022] PUT /identity/v3/projects/4cf861ead6d04331934a91210b174459/users/597d891898a44b7b8c1cc426ba42ee3a/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:29:06.067079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92132872-2665-4311-943f-21c558e0bbf1 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:06.067569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92132872-2665-4311-943f-21c558e0bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:06.067688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92132872-2665-4311-943f-21c558e0bbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:06.094556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-92132872-2665-4311-943f-21c558e0bbf1 None None] MFA Rules not processed for user `597d891898a44b7b8c1cc426ba42ee3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:06.095828 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-92132872-2665-4311-943f-21c558e0bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:06.162623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1182/2348] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:29:06.173745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eeeb72-415b-483b-9807-2e7c0a78c34e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:06.175526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-62eeeb72-415b-483b-9807-2e7c0a78c34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:06.252709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eeeb72-415b-483b-9807-2e7c0a78c34e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:06.258039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713e322-1ce7-4f34-8fe8-34d854a82d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:06.258713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e322-1ce7-4f34-8fe8-34d854a82d4e service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:06.258997 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e322-1ce7-4f34-8fe8-34d854a82d4e service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:06.259273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e322-1ce7-4f34-8fe8-34d854a82d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:06.315108 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713e322-1ce7-4f34-8fe8-34d854a82d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:06.316708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713e322-1ce7-4f34-8fe8-34d854a82d4e service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:06.327614 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1167/2349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:29:43.141869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31d5e3-aa96-4350-ad6f-d53645468a8c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:43.142586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31d5e3-aa96-4350-ad6f-d53645468a8c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:43.142586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31d5e3-aa96-4350-ad6f-d53645468a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:43.160307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-de31d5e3-aa96-4350-ad6f-d53645468a8c None None] MFA Rules not processed for user `78bb6c03eb73430d9d208839a8fecf52`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:43.161510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-de31d5e3-aa96-4350-ad6f-d53645468a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:43.168279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1183/2350] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:29:43.203443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713e322-1ce7-4f34-8fe8-34d854a82d4e service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:43.204824 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0713e322-1ce7-4f34-8fe8-34d854a82d4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:43.258460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713e322-1ce7-4f34-8fe8-34d854a82d4e service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:43.262473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:43.263106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:43.263389 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:43.263668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:43.265366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:43.278340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:43.279753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:43.290211 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1168/2351] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:29:43.583913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31d5e3-aa96-4350-ad6f-d53645468a8c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:43.585276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-de31d5e3-aa96-4350-ad6f-d53645468a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:43.640041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31d5e3-aa96-4350-ad6f-d53645468a8c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:43.643770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f97749-cc19-452f-af0f-85edbd4672ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:43.644467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f97749-cc19-452f-af0f-85edbd4672ab service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:43.644752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f97749-cc19-452f-af0f-85edbd4672ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:43.645034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f97749-cc19-452f-af0f-85edbd4672ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:43.646858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-32f97749-cc19-452f-af0f-85edbd4672ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:43.657880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f97749-cc19-452f-af0f-85edbd4672ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:43.659330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f97749-cc19-452f-af0f-85edbd4672ab service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:43.667937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1184/2352] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:29:44.110187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:44.111572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:44.114325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f97749-cc19-452f-af0f-85edbd4672ab service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:44.123215 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f97749-cc19-452f-af0f-85edbd4672ab service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:44.127043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6179a-f772-44a6-8ab3-3d8848f3f1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:44.127672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6179a-f772-44a6-8ab3-3d8848f3f1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:44.127958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6179a-f772-44a6-8ab3-3d8848f3f1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:44.128235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6179a-f772-44a6-8ab3-3d8848f3f1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:44.129996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e8e6179a-f772-44a6-8ab3-3d8848f3f1b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:44.143187 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6179a-f772-44a6-8ab3-3d8848f3f1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:44.144600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6179a-f772-44a6-8ab3-3d8848f3f1b4 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:44.155687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1185/2353] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:29:44.179218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bedb01-cf58-4a38-99e5-2b615b7c555f service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:44.184889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35ae873d42b490cae4dd610f2ac6a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:44.185534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:44.185814 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:44.186085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:44.187968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:44.199421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:44.200987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:44.210457 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1169/2354] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:29:46.061372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6179a-f772-44a6-8ab3-3d8848f3f1b4 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:46.070614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6179a-f772-44a6-8ab3-3d8848f3f1b4 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:46.074915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ffaa2-38b3-44a8-9215-ea7532d1b687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:46.075585 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffaa2-38b3-44a8-9215-ea7532d1b687 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:46.075851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffaa2-38b3-44a8-9215-ea7532d1b687 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:46.076129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffaa2-38b3-44a8-9215-ea7532d1b687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:46.077929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9e3ffaa2-38b3-44a8-9215-ea7532d1b687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:46.087855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ffaa2-38b3-44a8-9215-ea7532d1b687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:46.089358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ffaa2-38b3-44a8-9215-ea7532d1b687 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:46.099252 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1186/2355] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:29:47.519929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:47.521391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:47.585957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ed36-133e-4aad-9906-e3d303a6c9ad service placement] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:47.591340 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:47.592479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:47.593311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:47.593603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] PATH_INFO: `/v3/users/16fc0dcfe5c740c9a127df3a06352365` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:47.594995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=16fc0dcfe5c740c9a127df3a06352365)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:47.596965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:47.647544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16fc0dcfe5c740c9a127df3a06352365'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:47.660187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16fc0dcfe5c740c9a127df3a06352365'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:47.660956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16fc0dcfe5c740c9a127df3a06352365'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:47.669003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16fc0dcfe5c740c9a127df3a06352365'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:47.680538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-810e7fa9-303a-4c20-8fdd-7694760f4bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16fc0dcfe5c740c9a127df3a06352365'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:47.686485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1170/2356] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:29:47 2022] DELETE /identity/v3/users/16fc0dcfe5c740c9a127df3a06352365 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:29:47.861684 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ffaa2-38b3-44a8-9215-ea7532d1b687 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:47.874165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ffaa2-38b3-44a8-9215-ea7532d1b687 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:47.933731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:47.934690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:47.934970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:47.935246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] PATH_INFO: `/v3/projects/868d9faa77394355bc9160cd61ef3696` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:47.936442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868d9faa77394355bc9160cd61ef3696)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:47.938378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:47.983343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868d9faa77394355bc9160cd61ef3696', 'request_id': 'req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:47.990486 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868d9faa77394355bc9160cd61ef3696', 'request_id': 'req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:47.996550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868d9faa77394355bc9160cd61ef3696', 'request_id': 'req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:48.006280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] The token cache is being invalidate because project 868d9faa77394355bc9160cd61ef3696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:29:48.006572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:48.007214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7d2dba86-1d6e-47dd-87d6-c4fd42e8f905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:48.008786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1187/2357] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:29:47 2022] DELETE /identity/v3/projects/868d9faa77394355bc9160cd61ef3696 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:29:48.014614 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec3c33-2531-4c1c-b4a6-26b50c509c1d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.014908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec3c33-2531-4c1c-b4a6-26b50c509c1d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.015188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec3c33-2531-4c1c-b4a6-26b50c509c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.033694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-54ec3c33-2531-4c1c-b4a6-26b50c509c1d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:48.034851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-54ec3c33-2531-4c1c-b4a6-26b50c509c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:48.091605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1171/2358] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:29:48.099295 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5384b1-429f-42ea-9767-d8a619b7bdc5 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.099593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5384b1-429f-42ea-9767-d8a619b7bdc5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.099878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5384b1-429f-42ea-9767-d8a619b7bdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.119006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ef5384b1-429f-42ea-9767-d8a619b7bdc5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:48.120223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ef5384b1-429f-42ea-9767-d8a619b7bdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:48.128135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1188/2359] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:29:48.132333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec3c33-2531-4c1c-b4a6-26b50c509c1d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:48.142282 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec3c33-2531-4c1c-b4a6-26b50c509c1d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:48.146908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5c3d-ab4c-4acb-ad31-319d3fff2e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:48.147555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5c3d-ab4c-4acb-ad31-319d3fff2e49 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.147841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5c3d-ab4c-4acb-ad31-319d3fff2e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.148121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5c3d-ab4c-4acb-ad31-319d3fff2e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.148882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5c3d-ab4c-4acb-ad31-319d3fff2e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:29:48.149188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5c3d-ab4c-4acb-ad31-319d3fff2e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:48.150831 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5c3d-ab4c-4acb-ad31-319d3fff2e49 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:48.162935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1172/2360] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:29:48.167355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5384b1-429f-42ea-9767-d8a619b7bdc5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:48.176421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5384b1-429f-42ea-9767-d8a619b7bdc5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:48.181054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375a479-8149-49ed-acb2-8cdc73027c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:48.181718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375a479-8149-49ed-acb2-8cdc73027c52 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.181984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375a479-8149-49ed-acb2-8cdc73027c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.182298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375a479-8149-49ed-acb2-8cdc73027c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.183017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375a479-8149-49ed-acb2-8cdc73027c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:48.184950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375a479-8149-49ed-acb2-8cdc73027c52 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:48.209616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1189/2361] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:29:48 2022] POST /identity/v3/projects => generated 397 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:29:48.213576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5c3d-ab4c-4acb-ad31-319d3fff2e49 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:48.223987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5c3d-ab4c-4acb-ad31-319d3fff2e49 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:48.277100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a14ff-8d7a-4222-a163-21340606b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:48.277751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a14ff-8d7a-4222-a163-21340606b29d admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.278323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a14ff-8d7a-4222-a163-21340606b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.278712 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a14ff-8d7a-4222-a163-21340606b29d admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.279401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a14ff-8d7a-4222-a163-21340606b29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:48.281327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a14ff-8d7a-4222-a163-21340606b29d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:48.302090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1173/2362] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:29:48 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:29:48.305878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375a479-8149-49ed-acb2-8cdc73027c52 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:48.316366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375a479-8149-49ed-acb2-8cdc73027c52 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:48.320856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2f354-239e-4cfd-8f2e-2dfc816caa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:48.321505 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2f354-239e-4cfd-8f2e-2dfc816caa33 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.321787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2f354-239e-4cfd-8f2e-2dfc816caa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.322061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2f354-239e-4cfd-8f2e-2dfc816caa33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.322809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2f354-239e-4cfd-8f2e-2dfc816caa33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:48.324983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2f354-239e-4cfd-8f2e-2dfc816caa33 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:48.465109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1190/2363] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:29:48.469153 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a14ff-8d7a-4222-a163-21340606b29d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:48.478865 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a14ff-8d7a-4222-a163-21340606b29d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:48.483367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2685da-a3c3-49d5-97a0-f3611ffc906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:48.484011 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2685da-a3c3-49d5-97a0-f3611ffc906c admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.484291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2685da-a3c3-49d5-97a0-f3611ffc906c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.484567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2685da-a3c3-49d5-97a0-f3611ffc906c admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.485275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2685da-a3c3-49d5-97a0-f3611ffc906c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:48.487127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2685da-a3c3-49d5-97a0-f3611ffc906c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:48.497283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1174/2364] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:29:48.501029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2f354-239e-4cfd-8f2e-2dfc816caa33 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:48.511583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2f354-239e-4cfd-8f2e-2dfc816caa33 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:48.516625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98044a-914d-4af4-900f-81262fc54ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:48.517623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98044a-914d-4af4-900f-81262fc54ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.517904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98044a-914d-4af4-900f-81262fc54ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.518221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98044a-914d-4af4-900f-81262fc54ffd admin admin] PATH_INFO: `/v3/projects/6655931b73b147e9b410b68172c18b7b/users/baf4aab2f74e401dab90b1970b3e1f28/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.532397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98044a-914d-4af4-900f-81262fc54ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6655931b73b147e9b410b68172c18b7b, user_id=baf4aab2f74e401dab90b1970b3e1f28, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:48.535045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98044a-914d-4af4-900f-81262fc54ffd admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:48.547529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1191/2365] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:29:48 2022] PUT /identity/v3/projects/6655931b73b147e9b410b68172c18b7b/users/baf4aab2f74e401dab90b1970b3e1f28/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:29:48.557429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38bfce-a3c1-4d5e-aff6-0a32bbdf035c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.557921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38bfce-a3c1-4d5e-aff6-0a32bbdf035c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.558029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38bfce-a3c1-4d5e-aff6-0a32bbdf035c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.583628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-8e38bfce-a3c1-4d5e-aff6-0a32bbdf035c None None] MFA Rules not processed for user `baf4aab2f74e401dab90b1970b3e1f28`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:48.584797 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8e38bfce-a3c1-4d5e-aff6-0a32bbdf035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:48.647865 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1175/2366] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:29:48.659182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98044a-914d-4af4-900f-81262fc54ffd admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:48.660820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-df98044a-914d-4af4-900f-81262fc54ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:48.719538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98044a-914d-4af4-900f-81262fc54ffd admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:48.723176 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a953ab4-bfda-49b1-9b0f-7455ca59d417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:48.723812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a953ab4-bfda-49b1-9b0f-7455ca59d417 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:48.724117 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a953ab4-bfda-49b1-9b0f-7455ca59d417 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:48.724388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a953ab4-bfda-49b1-9b0f-7455ca59d417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:48.732436 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a953ab4-bfda-49b1-9b0f-7455ca59d417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:48.733826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a953ab4-bfda-49b1-9b0f-7455ca59d417 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:48.742566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1192/2367] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:29:57.782836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38bfce-a3c1-4d5e-aff6-0a32bbdf035c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:57.868032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38bfce-a3c1-4d5e-aff6-0a32bbdf035c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:57.873331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:57.874306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:57.874594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:57.874986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] PATH_INFO: `/v3/users/baf4aab2f74e401dab90b1970b3e1f28` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:57.876189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf4aab2f74e401dab90b1970b3e1f28)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:57.878120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:57.923781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf4aab2f74e401dab90b1970b3e1f28'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:57.931043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf4aab2f74e401dab90b1970b3e1f28'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:57.931758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf4aab2f74e401dab90b1970b3e1f28'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:57.939319 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf4aab2f74e401dab90b1970b3e1f28'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:57.950897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf4aab2f74e401dab90b1970b3e1f28'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:57.956840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1176/2368] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:29:57 2022] DELETE /identity/v3/users/baf4aab2f74e401dab90b1970b3e1f28 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:29:57.961359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a53fc7-76ec-4c6a-af19-c5c37add6766 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:57.961854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a53fc7-76ec-4c6a-af19-c5c37add6766 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:57.961959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a53fc7-76ec-4c6a-af19-c5c37add6766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:57.978797 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-61a53fc7-76ec-4c6a-af19-c5c37add6766 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:57.980616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-61a53fc7-76ec-4c6a-af19-c5c37add6766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:58.035086 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1193/2369] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:29:58.045288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:58.046836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:58.100819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a380ad-e508-4bb9-9269-4a53ce931483 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:58.104859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20a744-9de8-4bb0-bc74-015054d723dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:58.105522 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20a744-9de8-4bb0-bc74-015054d723dc service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.105807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20a744-9de8-4bb0-bc74-015054d723dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.106085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20a744-9de8-4bb0-bc74-015054d723dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.114950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20a744-9de8-4bb0-bc74-015054d723dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:58.116375 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20a744-9de8-4bb0-bc74-015054d723dc service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:58.126217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1177/2370] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:29:58.381601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a53fc7-76ec-4c6a-af19-c5c37add6766 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:58.383066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-61a53fc7-76ec-4c6a-af19-c5c37add6766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:58.395126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a53fc7-76ec-4c6a-af19-c5c37add6766 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:58.399736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:58.400611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.400887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.401730 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] PATH_INFO: `/v3/projects/6655931b73b147e9b410b68172c18b7b` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.403186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6655931b73b147e9b410b68172c18b7b)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:58.405050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:58.452237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6655931b73b147e9b410b68172c18b7b', 'request_id': 'req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:58.460372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6655931b73b147e9b410b68172c18b7b', 'request_id': 'req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:58.467582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6655931b73b147e9b410b68172c18b7b', 'request_id': 'req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:58.477744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] The token cache is being invalidate because project 6655931b73b147e9b410b68172c18b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:29:58.478041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:58.482500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-ed7fb5ba-7b8d-46ab-a176-45f60d04d610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:29:58.484101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1194/2371] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:29:58 2022] DELETE /identity/v3/projects/6655931b73b147e9b410b68172c18b7b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:29:58.489163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd43fb-06d0-49ea-8f11-cab78a960e72 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.489558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd43fb-06d0-49ea-8f11-cab78a960e72 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.489908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd43fb-06d0-49ea-8f11-cab78a960e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.507487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3acd43fb-06d0-49ea-8f11-cab78a960e72 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:58.508771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3acd43fb-06d0-49ea-8f11-cab78a960e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:58.567372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1178/2372] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:29:58.575574 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a2c7-8164-4e21-a708-9816339788e5 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.575861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a2c7-8164-4e21-a708-9816339788e5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.576162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a2c7-8164-4e21-a708-9816339788e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.594165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a691a2c7-8164-4e21-a708-9816339788e5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:58.595343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a691a2c7-8164-4e21-a708-9816339788e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:58.603107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1195/2373] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:29:58.607758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd43fb-06d0-49ea-8f11-cab78a960e72 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:58.617377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd43fb-06d0-49ea-8f11-cab78a960e72 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:58.622422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21539e7b-9036-41f2-ada7-6b62ca746707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:58.623092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539e7b-9036-41f2-ada7-6b62ca746707 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.623378 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539e7b-9036-41f2-ada7-6b62ca746707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.623654 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539e7b-9036-41f2-ada7-6b62ca746707 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.624438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21539e7b-9036-41f2-ada7-6b62ca746707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:29:58.624690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21539e7b-9036-41f2-ada7-6b62ca746707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:58.626327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21539e7b-9036-41f2-ada7-6b62ca746707 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:58.638240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1179/2374] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:29:58.642538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691a2c7-8164-4e21-a708-9816339788e5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:58.652241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691a2c7-8164-4e21-a708-9816339788e5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:58.657172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec06d4-f5aa-46a8-993d-b9b55e2b3d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:58.657813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec06d4-f5aa-46a8-993d-b9b55e2b3d36 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.658093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec06d4-f5aa-46a8-993d-b9b55e2b3d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.658411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec06d4-f5aa-46a8-993d-b9b55e2b3d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.659094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec06d4-f5aa-46a8-993d-b9b55e2b3d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:58.660955 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec06d4-f5aa-46a8-993d-b9b55e2b3d36 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:58.685430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1196/2375] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:29:58 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:29:58.689653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21539e7b-9036-41f2-ada7-6b62ca746707 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:58.699362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21539e7b-9036-41f2-ada7-6b62ca746707 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:58.757322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf7571-0d88-4a6e-85af-59a4fcc64414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:58.757984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf7571-0d88-4a6e-85af-59a4fcc64414 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.758302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf7571-0d88-4a6e-85af-59a4fcc64414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.758582 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf7571-0d88-4a6e-85af-59a4fcc64414 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.759281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf7571-0d88-4a6e-85af-59a4fcc64414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:58.761791 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf7571-0d88-4a6e-85af-59a4fcc64414 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:58.780876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1180/2376] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:29:58 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:29:58.785004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec06d4-f5aa-46a8-993d-b9b55e2b3d36 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:58.795134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec06d4-f5aa-46a8-993d-b9b55e2b3d36 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:58.799586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc78e3e-61e1-40b0-acf7-7d64ca0be88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:58.800232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc78e3e-61e1-40b0-acf7-7d64ca0be88f admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.800552 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc78e3e-61e1-40b0-acf7-7d64ca0be88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.800833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc78e3e-61e1-40b0-acf7-7d64ca0be88f admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.801543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc78e3e-61e1-40b0-acf7-7d64ca0be88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:58.803150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc78e3e-61e1-40b0-acf7-7d64ca0be88f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:58.813105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1197/2377] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:29:58.816967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf7571-0d88-4a6e-85af-59a4fcc64414 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:58.827525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf7571-0d88-4a6e-85af-59a4fcc64414 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:58.832051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d4c96-610c-4f1a-96ab-adddbdce0a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:58.832698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d4c96-610c-4f1a-96ab-adddbdce0a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.832982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d4c96-610c-4f1a-96ab-adddbdce0a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.833257 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d4c96-610c-4f1a-96ab-adddbdce0a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.833974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d4c96-610c-4f1a-96ab-adddbdce0a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:58.835618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d4c96-610c-4f1a-96ab-adddbdce0a8a admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:58.845770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1181/2378] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:29:58.849713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc78e3e-61e1-40b0-acf7-7d64ca0be88f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:58.860101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc78e3e-61e1-40b0-acf7-7d64ca0be88f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:58.864713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118973-cae9-40cc-8499-63fa37891afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:58.865584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118973-cae9-40cc-8499-63fa37891afb admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.865865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118973-cae9-40cc-8499-63fa37891afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.866172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118973-cae9-40cc-8499-63fa37891afb admin admin] PATH_INFO: `/v3/projects/55e43dcbd9b149b4abf235a40dd4a211/users/b7eb6740ee4547fdaa5df3ba69640adf/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.882154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118973-cae9-40cc-8499-63fa37891afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e43dcbd9b149b4abf235a40dd4a211, user_id=b7eb6740ee4547fdaa5df3ba69640adf, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:58.884841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118973-cae9-40cc-8499-63fa37891afb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:58.902233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1198/2379] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:29:58 2022] PUT /identity/v3/projects/55e43dcbd9b149b4abf235a40dd4a211/users/b7eb6740ee4547fdaa5df3ba69640adf/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:29:58.907971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdeaa-404e-483b-9349-3a66da5b7d45 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:58.909165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdeaa-404e-483b-9349-3a66da5b7d45 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:58.909790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdeaa-404e-483b-9349-3a66da5b7d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:58.933441 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a30bdeaa-404e-483b-9349-3a66da5b7d45 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:29:58.934667 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a30bdeaa-404e-483b-9349-3a66da5b7d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:58.995641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1182/2380] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:29:59.004767 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118973-cae9-40cc-8499-63fa37891afb admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:59.006727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-31118973-cae9-40cc-8499-63fa37891afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:59.062965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118973-cae9-40cc-8499-63fa37891afb admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:59.066639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429179df-a6b8-4788-93fe-ad3bbe6fe0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:59.067410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429179df-a6b8-4788-93fe-ad3bbe6fe0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:59.067700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429179df-a6b8-4788-93fe-ad3bbe6fe0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:29:59.067978 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429179df-a6b8-4788-93fe-ad3bbe6fe0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:29:59.077608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429179df-a6b8-4788-93fe-ad3bbe6fe0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:29:59.079088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429179df-a6b8-4788-93fe-ad3bbe6fe0b6 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:29:59.088457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1199/2381] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:29:59.901931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bdeaa-404e-483b-9349-3a66da5b7d45 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:29:59.905066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a30bdeaa-404e-483b-9349-3a66da5b7d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:29:59.992453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bdeaa-404e-483b-9349-3a66da5b7d45 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:29:59.998728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112807-025a-4588-82eb-963b323b07e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:29:59.999500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112807-025a-4588-82eb-963b323b07e9 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:29:59.999879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112807-025a-4588-82eb-963b323b07e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:00.000261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112807-025a-4588-82eb-963b323b07e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:00.002336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c0112807-025a-4588-82eb-963b323b07e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:30:00.017422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0112807-025a-4588-82eb-963b323b07e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:00.019095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0112807-025a-4588-82eb-963b323b07e9 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:00.031747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1183/2382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:29:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:30:03.200240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bda7b-a9e2-482f-a525-570fd2a5b94a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:03.200740 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bda7b-a9e2-482f-a525-570fd2a5b94a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:03.200849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bda7b-a9e2-482f-a525-570fd2a5b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:03.235152 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-844bda7b-a9e2-482f-a525-570fd2a5b94a None None] MFA Rules not processed for user `b7eb6740ee4547fdaa5df3ba69640adf`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:30:03.236964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-844bda7b-a9e2-482f-a525-570fd2a5b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:30:03.347906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1200/2383] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:30:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:30:03.349075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112807-025a-4588-82eb-963b323b07e9 service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:03.359667 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112807-025a-4588-82eb-963b323b07e9 service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:03.368112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f551ea-82b2-40bd-b0f6-a08ab33a5346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:03.368877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f551ea-82b2-40bd-b0f6-a08ab33a5346 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:03.369177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f551ea-82b2-40bd-b0f6-a08ab33a5346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:03.369675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f551ea-82b2-40bd-b0f6-a08ab33a5346 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:03.370417 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f551ea-82b2-40bd-b0f6-a08ab33a5346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:03.372624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f551ea-82b2-40bd-b0f6-a08ab33a5346 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:03.399715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1184/2384] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:30:03 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:30:03.404598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bda7b-a9e2-482f-a525-570fd2a5b94a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:03.418301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bda7b-a9e2-482f-a525-570fd2a5b94a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:03.511884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72b5f0-99bc-4b0b-85f5-f11e3a98e8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:03.512571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b5f0-99bc-4b0b-85f5-f11e3a98e8ba admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:03.512855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b5f0-99bc-4b0b-85f5-f11e3a98e8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:03.513132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b5f0-99bc-4b0b-85f5-f11e3a98e8ba admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:03.513825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72b5f0-99bc-4b0b-85f5-f11e3a98e8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:03.516927 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72b5f0-99bc-4b0b-85f5-f11e3a98e8ba admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:03.527164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f551ea-82b2-40bd-b0f6-a08ab33a5346 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:03.546095 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1201/2385] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:30:03 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:30:03.550082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72b5f0-99bc-4b0b-85f5-f11e3a98e8ba admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:03.560743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72b5f0-99bc-4b0b-85f5-f11e3a98e8ba admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:03.565541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2493e07-993c-4c48-85e8-72a73275b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:03.566262 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2493e07-993c-4c48-85e8-72a73275b585 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:03.566550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2493e07-993c-4c48-85e8-72a73275b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:03.566811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2493e07-993c-4c48-85e8-72a73275b585 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:03.567538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2493e07-993c-4c48-85e8-72a73275b585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:03.569133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2493e07-993c-4c48-85e8-72a73275b585 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:03.586263 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1202/2386] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:30:03.590970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2493e07-993c-4c48-85e8-72a73275b585 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:03.600592 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f551ea-82b2-40bd-b0f6-a08ab33a5346 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:03.601894 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2493e07-993c-4c48-85e8-72a73275b585 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:03.604514 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382a86-1da6-4230-9a7e-ac04ed98d522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:03.605237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382a86-1da6-4230-9a7e-ac04ed98d522 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:03.605609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382a86-1da6-4230-9a7e-ac04ed98d522 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:03.605954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382a86-1da6-4230-9a7e-ac04ed98d522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:03.606982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ad371-c919-4af8-bac6-c6fe0a0e9972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:03.607906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ad371-c919-4af8-bac6-c6fe0a0e9972 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:03.608029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d5382a86-1da6-4230-9a7e-ac04ed98d522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:30:03.608312 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ad371-c919-4af8-bac6-c6fe0a0e9972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:03.608659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ad371-c919-4af8-bac6-c6fe0a0e9972 admin admin] PATH_INFO: `/v3/projects/fd40a4cee66c4e2ba3a1c942da77340b/users/cf5c251d6ada4447a967b2e87f2c20f4/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:03.628350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ad371-c919-4af8-bac6-c6fe0a0e9972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd40a4cee66c4e2ba3a1c942da77340b, user_id=cf5c251d6ada4447a967b2e87f2c20f4, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:03.631303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ad371-c919-4af8-bac6-c6fe0a0e9972 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:03.649415 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1203/2387] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:30:03 2022] PUT /identity/v3/projects/fd40a4cee66c4e2ba3a1c942da77340b/users/cf5c251d6ada4447a967b2e87f2c20f4/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:30:03.653527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ad371-c919-4af8-bac6-c6fe0a0e9972 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:03.686937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5382a86-1da6-4230-9a7e-ac04ed98d522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:03.688448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5382a86-1da6-4230-9a7e-ac04ed98d522 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:03.700897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1185/2388] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:30:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:30:03.722617 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ad371-c919-4af8-bac6-c6fe0a0e9972 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:03.727790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d9778-e40f-43db-9405-4804e24406be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:03.728612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d9778-e40f-43db-9405-4804e24406be admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:03.729025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d9778-e40f-43db-9405-4804e24406be admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:03.729396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d9778-e40f-43db-9405-4804e24406be admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:03.730325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d9778-e40f-43db-9405-4804e24406be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:03.732029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d9778-e40f-43db-9405-4804e24406be admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:03.743470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1204/2389] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:30:03.747939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382a86-1da6-4230-9a7e-ac04ed98d522 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:03.759044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382a86-1da6-4230-9a7e-ac04ed98d522 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:03.764631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0daa767-bbc7-481d-b55f-e8f43bd89a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:03.766266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0daa767-bbc7-481d-b55f-e8f43bd89a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:03.766653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0daa767-bbc7-481d-b55f-e8f43bd89a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:03.767191 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0daa767-bbc7-481d-b55f-e8f43bd89a51 admin admin] PATH_INFO: `/v3/projects/fd40a4cee66c4e2ba3a1c942da77340b/users/cf5c251d6ada4447a967b2e87f2c20f4/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:03.770881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0daa767-bbc7-481d-b55f-e8f43bd89a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd40a4cee66c4e2ba3a1c942da77340b, user_id=cf5c251d6ada4447a967b2e87f2c20f4, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:03.774265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0daa767-bbc7-481d-b55f-e8f43bd89a51 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:03.786890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1186/2390] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:30:03 2022] PUT /identity/v3/projects/fd40a4cee66c4e2ba3a1c942da77340b/users/cf5c251d6ada4447a967b2e87f2c20f4/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:30:07.782898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d9778-e40f-43db-9405-4804e24406be admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:07.785729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4e7d9778-e40f-43db-9405-4804e24406be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:30:07.893870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d9778-e40f-43db-9405-4804e24406be admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:08.064681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52eb47-f40d-4f22-9ca6-e94f7d269072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:08.065655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52eb47-f40d-4f22-9ca6-e94f7d269072 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:08.066096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52eb47-f40d-4f22-9ca6-e94f7d269072 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:08.066759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52eb47-f40d-4f22-9ca6-e94f7d269072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:08.069843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9a52eb47-f40d-4f22-9ca6-e94f7d269072 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:30:08.089388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52eb47-f40d-4f22-9ca6-e94f7d269072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:08.091945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52eb47-f40d-4f22-9ca6-e94f7d269072 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:08.107953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1205/2391] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:30:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:30:10.529326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb81d8-0093-44e9-9280-bf515f524c28 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:10.530323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb81d8-0093-44e9-9280-bf515f524c28 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:10.530845 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb81d8-0093-44e9-9280-bf515f524c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:10.559875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-c9eb81d8-0093-44e9-9280-bf515f524c28 None None] MFA Rules not processed for user `cf5c251d6ada4447a967b2e87f2c20f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:30:10.561232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c9eb81d8-0093-44e9-9280-bf515f524c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:30:10.629300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1187/2392] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:30:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:30:10.642300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52eb47-f40d-4f22-9ca6-e94f7d269072 service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:10.654527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52eb47-f40d-4f22-9ca6-e94f7d269072 service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:10.659955 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e796740-ce95-4f35-a17f-a70e5a01ec09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:10.660617 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e796740-ce95-4f35-a17f-a70e5a01ec09 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:10.660899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e796740-ce95-4f35-a17f-a70e5a01ec09 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:10.661175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e796740-ce95-4f35-a17f-a70e5a01ec09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:10.715244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e796740-ce95-4f35-a17f-a70e5a01ec09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:10.716742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e796740-ce95-4f35-a17f-a70e5a01ec09 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:10.725305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1206/2393] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:30:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:30:11.889140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f220-e86f-4e79-8101-50d8d3f97b0f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:11.889715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f220-e86f-4e79-8101-50d8d3f97b0f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:11.889903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f220-e86f-4e79-8101-50d8d3f97b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:11.909817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3524f220-e86f-4e79-8101-50d8d3f97b0f None None] MFA Rules not processed for user `b7eb6740ee4547fdaa5df3ba69640adf`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:30:11.911122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3524f220-e86f-4e79-8101-50d8d3f97b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:30:11.923566 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1188/2394] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:30:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:30:37.233869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e796740-ce95-4f35-a17f-a70e5a01ec09 service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:37.245040 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e796740-ce95-4f35-a17f-a70e5a01ec09 service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:37.250497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc593e-7607-442d-9f2f-b3d03e908ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:37.251132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc593e-7607-442d-9f2f-b3d03e908ed0 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:37.251442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc593e-7607-442d-9f2f-b3d03e908ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:37.251720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc593e-7607-442d-9f2f-b3d03e908ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:37.253448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2fbc593e-7607-442d-9f2f-b3d03e908ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:30:37.309432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc593e-7607-442d-9f2f-b3d03e908ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:37.311037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc593e-7607-442d-9f2f-b3d03e908ed0 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:37.319815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1207/2395] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:30:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:30:58.639015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524f220-e86f-4e79-8101-50d8d3f97b0f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:30:58.640673 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3524f220-e86f-4e79-8101-50d8d3f97b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:30:58.694547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524f220-e86f-4e79-8101-50d8d3f97b0f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:30:58.698591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7068b8-c964-4a50-9dd3-e7a431f81fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:30:58.699217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7068b8-c964-4a50-9dd3-e7a431f81fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:30:58.699496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7068b8-c964-4a50-9dd3-e7a431f81fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:30:58.699766 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7068b8-c964-4a50-9dd3-e7a431f81fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:30:58.708296 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7068b8-c964-4a50-9dd3-e7a431f81fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:30:58.709701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7068b8-c964-4a50-9dd3-e7a431f81fb3 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:30:58.719312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1189/2396] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:30:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:31:05.925073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc593e-7607-442d-9f2f-b3d03e908ed0 service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:05.936665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc593e-7607-442d-9f2f-b3d03e908ed0 service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:05.942192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55c7bd-968f-4518-93b6-7e40fe2fefc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:05.942830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55c7bd-968f-4518-93b6-7e40fe2fefc4 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:05.943109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55c7bd-968f-4518-93b6-7e40fe2fefc4 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:05.943382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55c7bd-968f-4518-93b6-7e40fe2fefc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:05.945129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fa55c7bd-968f-4518-93b6-7e40fe2fefc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:06.001256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55c7bd-968f-4518-93b6-7e40fe2fefc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:06.002851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55c7bd-968f-4518-93b6-7e40fe2fefc4 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:06.011986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1208/2397] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:31:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:31:20.952908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28943713-6e2d-4ce1-9102-ba56b660cd32 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:20.953443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28943713-6e2d-4ce1-9102-ba56b660cd32 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:20.953443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28943713-6e2d-4ce1-9102-ba56b660cd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:20.970471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-28943713-6e2d-4ce1-9102-ba56b660cd32 None None] MFA Rules not processed for user `719425608bc4447ea2f433e12ebbb180`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:31:20.971670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-28943713-6e2d-4ce1-9102-ba56b660cd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:20.978392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1190/2398] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:31:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:31:21.271792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55c7bd-968f-4518-93b6-7e40fe2fefc4 service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:21.281084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55c7bd-968f-4518-93b6-7e40fe2fefc4 service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:21.284613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d580a-884a-46ea-bc1f-96e5a534b41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:21.285249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d580a-884a-46ea-bc1f-96e5a534b41b service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:21.285533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d580a-884a-46ea-bc1f-96e5a534b41b service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:21.285811 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d580a-884a-46ea-bc1f-96e5a534b41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:21.287582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6f5d580a-884a-46ea-bc1f-96e5a534b41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:21.297425 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d580a-884a-46ea-bc1f-96e5a534b41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:21.298871 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d580a-884a-46ea-bc1f-96e5a534b41b service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:21.306688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1209/2399] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:31:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:31:25.051479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28943713-6e2d-4ce1-9102-ba56b660cd32 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:25.066079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28943713-6e2d-4ce1-9102-ba56b660cd32 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:25.073978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:25.074988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:25.075447 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:25.075900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:25.078225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:25.174467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:25.176183 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:25.185752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1191/2400] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:31:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:31:34.283153 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad8333-bcec-46c4-9a69-e8cd17a3ec68 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:34.283641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad8333-bcec-46c4-9a69-e8cd17a3ec68 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:34.283738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad8333-bcec-46c4-9a69-e8cd17a3ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:34.313498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-4cad8333-bcec-46c4-9a69-e8cd17a3ec68 None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:31:34.314872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4cad8333-bcec-46c4-9a69-e8cd17a3ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:34.375451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1210/2401] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:31:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:31:34.443769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:34.448447 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:34.528705 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c6c6d-b6d7-4082-a7c7-575fcce39f62 service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:34.534402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac60db2-70b2-4d4f-ace1-dec333010174 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:34.535300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac60db2-70b2-4d4f-ace1-dec333010174 service swift] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:34.535739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac60db2-70b2-4d4f-ace1-dec333010174 service swift] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:34.536013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac60db2-70b2-4d4f-ace1-dec333010174 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:34.546545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac60db2-70b2-4d4f-ace1-dec333010174 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:34.548232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac60db2-70b2-4d4f-ace1-dec333010174 service swift] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:34.562294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1192/2402] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:31:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:31:36.699696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc9697-86e9-4ce3-983e-e4db069c1e24 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:36.700611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc9697-86e9-4ce3-983e-e4db069c1e24 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:36.701049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc9697-86e9-4ce3-983e-e4db069c1e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:36.738429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-75cc9697-86e9-4ce3-983e-e4db069c1e24 None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:31:36.740029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-75cc9697-86e9-4ce3-983e-e4db069c1e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:36.748667 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1211/2403] 10.222.0.16 () {58 vars in 967 bytes} [Thu Mar 10 17:31:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:31:36.770035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac60db2-70b2-4d4f-ace1-dec333010174 service swift] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:36.783675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac60db2-70b2-4d4f-ace1-dec333010174 service swift] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:36.789399 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4de48-3df3-45ba-b84e-9a41918ececc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:36.789970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4de48-3df3-45ba-b84e-9a41918ececc service swift] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:36.790307 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4de48-3df3-45ba-b84e-9a41918ececc service swift] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:36.790636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4de48-3df3-45ba-b84e-9a41918ececc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:36.800065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4de48-3df3-45ba-b84e-9a41918ececc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:36.801885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4de48-3df3-45ba-b84e-9a41918ececc service swift] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:36.810674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1193/2404] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:31:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 10 17:31:37.316671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc9697-86e9-4ce3-983e-e4db069c1e24 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:37.327049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc9697-86e9-4ce3-983e-e4db069c1e24 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:37.330960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:37.331799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:37.332080 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:37.332354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:37.334404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:37.428141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:37.430344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:37.445047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1212/2405] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:31:39.526918 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4de48-3df3-45ba-b84e-9a41918ececc service swift] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:39.541073 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4de48-3df3-45ba-b84e-9a41918ececc service swift] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:39.547614 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af3c41-67a4-4006-b043-0a9eb68123a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:39.548845 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3c41-67a4-4006-b043-0a9eb68123a9 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:39.550363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3c41-67a4-4006-b043-0a9eb68123a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:39.550882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3c41-67a4-4006-b043-0a9eb68123a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:39.552951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-77af3c41-67a4-4006-b043-0a9eb68123a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:39.573169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af3c41-67a4-4006-b043-0a9eb68123a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:39.574889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af3c41-67a4-4006-b043-0a9eb68123a9 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:39.603440 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1194/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:31:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:31:46.635605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:46.637168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:46.649473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff275d-d7db-4ca3-bfe9-790dfaeeed03 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:46.654286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:46.655168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:46.655448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:46.655722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] PATH_INFO: `/v3/users/6d165ef4da394bac8cfa332f49571467` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:46.656915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d165ef4da394bac8cfa332f49571467)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:46.658847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:46.720455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d165ef4da394bac8cfa332f49571467'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:46.727535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d165ef4da394bac8cfa332f49571467'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:46.735320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d165ef4da394bac8cfa332f49571467'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:46.736047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d165ef4da394bac8cfa332f49571467'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:46.736713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d165ef4da394bac8cfa332f49571467'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:46.754453 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1213/2407] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:31:46 2022] DELETE /identity/v3/users/6d165ef4da394bac8cfa332f49571467 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:31:47.036421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af3c41-67a4-4006-b043-0a9eb68123a9 service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:47.048289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af3c41-67a4-4006-b043-0a9eb68123a9 service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:47.113415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:47.114231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:47.114515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:47.114787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] PATH_INFO: `/v3/projects/788735d9fc2b4767b361bcc431fa4542` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:47.116007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=788735d9fc2b4767b361bcc431fa4542)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:47.117903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:47.163554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788735d9fc2b4767b361bcc431fa4542', 'request_id': 'req-6f025db6-0fc2-4953-9bfc-7ed90279bc53'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.170119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788735d9fc2b4767b361bcc431fa4542', 'request_id': 'req-6f025db6-0fc2-4953-9bfc-7ed90279bc53'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.177663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788735d9fc2b4767b361bcc431fa4542', 'request_id': 'req-6f025db6-0fc2-4953-9bfc-7ed90279bc53'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.188015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] The token cache is being invalidate because project 788735d9fc2b4767b361bcc431fa4542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:31:47.188300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.188933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.190505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1195/2408] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:31:47 2022] DELETE /identity/v3/projects/788735d9fc2b4767b361bcc431fa4542 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:31:47.194451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:47.195964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:47.210266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba91dbb-8967-4233-84a0-66e511182ce4 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:47.265057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:47.265931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:47.266237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:47.266509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] PATH_INFO: `/v3/users/a020660427c341fe9175077503134f12` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:47.267747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a020660427c341fe9175077503134f12)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:47.269633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:47.316771 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a020660427c341fe9175077503134f12'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.323438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a020660427c341fe9175077503134f12'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.330511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a020660427c341fe9175077503134f12'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.331121 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a020660427c341fe9175077503134f12'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.331718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2908c627-c684-448a-9087-f2ddb8b168f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a020660427c341fe9175077503134f12'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.348578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1214/2409] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:31:47 2022] DELETE /identity/v3/users/a020660427c341fe9175077503134f12 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:31:47.596341 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:47.598237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:47.616733 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f025db6-0fc2-4953-9bfc-7ed90279bc53 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:47.673942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:47.674745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:47.675043 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:47.675299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] PATH_INFO: `/v3/projects/53e20bda2662421eaf68196d2cdafb61` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:47.676468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e20bda2662421eaf68196d2cdafb61)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:47.678398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:47.722801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e20bda2662421eaf68196d2cdafb61', 'request_id': 'req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.728620 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e20bda2662421eaf68196d2cdafb61', 'request_id': 'req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.735337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e20bda2662421eaf68196d2cdafb61', 'request_id': 'req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.744994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] The token cache is being invalidate because project 53e20bda2662421eaf68196d2cdafb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:31:47.745279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.745899 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-6ac8b8f5-fc4c-4754-b75e-b671252bd1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:31:47.747431 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1196/2410] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:31:47 2022] DELETE /identity/v3/projects/53e20bda2662421eaf68196d2cdafb61 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:31:50.484409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95a9f-d82e-4261-9291-c8a54cc2c4e5 None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:50.485219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95a9f-d82e-4261-9291-c8a54cc2c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:50.485219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95a9f-d82e-4261-9291-c8a54cc2c4e5 None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:50.486813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1215/2411] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:31:50.493140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b4f3-24e3-48c5-a294-988606d1d682 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:50.493624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b4f3-24e3-48c5-a294-988606d1d682 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:50.493719 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b4f3-24e3-48c5-a294-988606d1d682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:50.532745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-cea9b4f3-24e3-48c5-a294-988606d1d682 None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:31:50.533966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cea9b4f3-24e3-48c5-a294-988606d1d682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:50.597443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1197/2412] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:31:50.608824 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee95a9f-d82e-4261-9291-c8a54cc2c4e5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:50.610898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-dee95a9f-d82e-4261-9291-c8a54cc2c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:50.687320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee95a9f-d82e-4261-9291-c8a54cc2c4e5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:50.690892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0c2bf-065e-4fdd-b1eb-91bde0443ac2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9a11df2d3d4dc292a5115de69bb288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:50.691525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0c2bf-065e-4fdd-b1eb-91bde0443ac2 service glance] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:50.691809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0c2bf-065e-4fdd-b1eb-91bde0443ac2 service glance] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:50.692080 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0c2bf-065e-4fdd-b1eb-91bde0443ac2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:50.702674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0c2bf-065e-4fdd-b1eb-91bde0443ac2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:50.704078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0c2bf-065e-4fdd-b1eb-91bde0443ac2 service glance] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:50.715165 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1216/2413] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:31:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:31:50.780415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bf48f-d252-4bd4-b5bf-6a01208f0d12 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:50.780713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bf48f-d252-4bd4-b5bf-6a01208f0d12 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:50.781000 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bf48f-d252-4bd4-b5bf-6a01208f0d12 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:50.782839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1198/2414] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:31:50.787518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9cb0b-c39d-4f0c-bca5-f79f0102ac80 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:50.787816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9cb0b-c39d-4f0c-bca5-f79f0102ac80 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:50.788095 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9cb0b-c39d-4f0c-bca5-f79f0102ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:50.806235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e2f9cb0b-c39d-4f0c-bca5-f79f0102ac80 None None] MFA Rules not processed for user `701c0e43cc30442582456f4f7153333a`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:31:50.807420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e2f9cb0b-c39d-4f0c-bca5-f79f0102ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:50.855789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1217/2415] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:31:50.867469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bf48f-d252-4bd4-b5bf-6a01208f0d12 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:50.869690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ea8bf48f-d252-4bd4-b5bf-6a01208f0d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:50.882630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bf48f-d252-4bd4-b5bf-6a01208f0d12 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:50.886781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0fb01-9664-4f5d-85f1-886523107f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:50.887416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0fb01-9664-4f5d-85f1-886523107f51 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:50.887702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0fb01-9664-4f5d-85f1-886523107f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:50.887983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0fb01-9664-4f5d-85f1-886523107f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:50.895088 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0fb01-9664-4f5d-85f1-886523107f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:50.896533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0fb01-9664-4f5d-85f1-886523107f51 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:50.904452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1199/2416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:31:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:31:50.991639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcf765-acb8-429b-a66e-70a67036684e None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:50.991932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcf765-acb8-429b-a66e-70a67036684e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:50.992212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcf765-acb8-429b-a66e-70a67036684e None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:50.994515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1218/2417] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:31:50.999905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4b68-8da4-4876-8398-0785eef54d10 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:51.000194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4b68-8da4-4876-8398-0785eef54d10 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:51.000474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4b68-8da4-4876-8398-0785eef54d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:51.019067 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-cbed4b68-8da4-4876-8398-0785eef54d10 None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:31:51.020268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cbed4b68-8da4-4876-8398-0785eef54d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:51.029704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1200/2418] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:31:51.039955 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcf765-acb8-429b-a66e-70a67036684e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:51.050692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcf765-acb8-429b-a66e-70a67036684e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:51.054276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e113cc-99f0-42a8-8fa2-b2b2591161c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:51.054907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e113cc-99f0-42a8-8fa2-b2b2591161c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:51.055188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e113cc-99f0-42a8-8fa2-b2b2591161c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:51.055464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e113cc-99f0-42a8-8fa2-b2b2591161c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:51.065688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e113cc-99f0-42a8-8fa2-b2b2591161c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:51.067150 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e113cc-99f0-42a8-8fa2-b2b2591161c9 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:51.078048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1219/2419] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:31:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:31:53.688328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0025-a6d6-4573-a054-790df2167b0c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:53.688794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0025-a6d6-4573-a054-790df2167b0c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:53.688882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0025-a6d6-4573-a054-790df2167b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:53.708394 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-90df0025-a6d6-4573-a054-790df2167b0c None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:31:53.709583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-90df0025-a6d6-4573-a054-790df2167b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:53.760954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1201/2420] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:31:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:31:53.772771 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e113cc-99f0-42a8-8fa2-b2b2591161c9 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:31:53.774176 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d8e113cc-99f0-42a8-8fa2-b2b2591161c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:31:53.839590 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e113cc-99f0-42a8-8fa2-b2b2591161c9 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:31:53.844439 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285e0f4-2648-4bab-97cd-c6ece1186d16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:31:53.845076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285e0f4-2648-4bab-97cd-c6ece1186d16 service swift] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:31:53.845363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285e0f4-2648-4bab-97cd-c6ece1186d16 service swift] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:31:53.845642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285e0f4-2648-4bab-97cd-c6ece1186d16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:31:53.853548 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285e0f4-2648-4bab-97cd-c6ece1186d16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:31:53.855151 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285e0f4-2648-4bab-97cd-c6ece1186d16 service swift] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:31:53.862901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1220/2421] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:31:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:32:19.650576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0975684-d85b-484d-a821-771cd72c3edc None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:32:19.651107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0975684-d85b-484d-a821-771cd72c3edc None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:32:19.651213 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0975684-d85b-484d-a821-771cd72c3edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:32:19.668132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b0975684-d85b-484d-a821-771cd72c3edc None None] MFA Rules not processed for user `9dbdadbe21e542dcb1c3dad9d67e8a92`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:32:19.669323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b0975684-d85b-484d-a821-771cd72c3edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:32:19.727205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1202/2422] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:32:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:32:20.805857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013c4a-d551-4b1a-b5f3-052e85e123dc None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:32:20.806416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013c4a-d551-4b1a-b5f3-052e85e123dc None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:32:20.806505 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013c4a-d551-4b1a-b5f3-052e85e123dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:32:20.824274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-20013c4a-d551-4b1a-b5f3-052e85e123dc None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:32:20.825467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-20013c4a-d551-4b1a-b5f3-052e85e123dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:32:20.833179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1221/2423] 10.222.0.16 () {58 vars in 967 bytes} [Thu Mar 10 17:32:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:32:20.845907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0975684-d85b-484d-a821-771cd72c3edc None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:32:20.857478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0975684-d85b-484d-a821-771cd72c3edc None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:32:20.862482 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e20452-e830-4b52-b6de-3e5dd9b12ba4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:32:20.863120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e20452-e830-4b52-b6de-3e5dd9b12ba4 service swift] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:32:20.863398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e20452-e830-4b52-b6de-3e5dd9b12ba4 service swift] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:32:20.863674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e20452-e830-4b52-b6de-3e5dd9b12ba4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:32:20.873750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e20452-e830-4b52-b6de-3e5dd9b12ba4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:32:20.875731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e20452-e830-4b52-b6de-3e5dd9b12ba4 service swift] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:32:20.884237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1203/2424] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:32:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:32:52.199467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af43800-e616-4bc4-bd04-d57c20e42207 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:32:52.199973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af43800-e616-4bc4-bd04-d57c20e42207 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:32:52.200079 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af43800-e616-4bc4-bd04-d57c20e42207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:32:52.216756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-1af43800-e616-4bc4-bd04-d57c20e42207 None None] MFA Rules not processed for user `78bb6c03eb73430d9d208839a8fecf52`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:32:52.217926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1af43800-e616-4bc4-bd04-d57c20e42207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:32:52.269484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1222/2425] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:32:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:33:23.983623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e20452-e830-4b52-b6de-3e5dd9b12ba4 service swift] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:33:23.985056 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-04e20452-e830-4b52-b6de-3e5dd9b12ba4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:33:24.056622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e20452-e830-4b52-b6de-3e5dd9b12ba4 service swift] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:33:24.061849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734eba2-211b-4790-a07e-867cd717175f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35ae873d42b490cae4dd610f2ac6a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:33:24.062534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734eba2-211b-4790-a07e-867cd717175f service placement] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:24.062934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734eba2-211b-4790-a07e-867cd717175f service placement] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:24.063221 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734eba2-211b-4790-a07e-867cd717175f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:24.065148 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c734eba2-211b-4790-a07e-867cd717175f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:33:24.077045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734eba2-211b-4790-a07e-867cd717175f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:33:24.078664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734eba2-211b-4790-a07e-867cd717175f service placement] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:33:24.088631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1204/2426] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:33:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:33:27.227383 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd13854-cde3-42fc-a5f9-1465e0a9b07f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:27.227890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd13854-cde3-42fc-a5f9-1465e0a9b07f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:27.228090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd13854-cde3-42fc-a5f9-1465e0a9b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:27.245200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-dcd13854-cde3-42fc-a5f9-1465e0a9b07f None None] MFA Rules not processed for user `719425608bc4447ea2f433e12ebbb180`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:33:27.246418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-dcd13854-cde3-42fc-a5f9-1465e0a9b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:33:27.299864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1223/2427] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:33:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:33:37.473311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dec50-b4dd-4666-ac8c-7aad805099d3 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:37.473842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dec50-b4dd-4666-ac8c-7aad805099d3 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:37.473946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dec50-b4dd-4666-ac8c-7aad805099d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:37.491062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ce5dec50-b4dd-4666-ac8c-7aad805099d3 None None] MFA Rules not processed for user `d791b80cee0d494c9a307e6293f68679`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:33:37.492243 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ce5dec50-b4dd-4666-ac8c-7aad805099d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:33:37.545286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1205/2428] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:33:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:33:40.504277 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd13854-cde3-42fc-a5f9-1465e0a9b07f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:33:40.505775 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-dcd13854-cde3-42fc-a5f9-1465e0a9b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:33:40.521188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd13854-cde3-42fc-a5f9-1465e0a9b07f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:33:40.527051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3922-1a5b-4f82-8764-2e769ccac7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:33:40.528267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3922-1a5b-4f82-8764-2e769ccac7ab service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:40.528548 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3922-1a5b-4f82-8764-2e769ccac7ab service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:40.528941 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3922-1a5b-4f82-8764-2e769ccac7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:40.530750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-90ce3922-1a5b-4f82-8764-2e769ccac7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:33:40.541282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3922-1a5b-4f82-8764-2e769ccac7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:33:40.543962 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3922-1a5b-4f82-8764-2e769ccac7ab service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:33:40.553072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1224/2429] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:33:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:33:46.631905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e187-4a93-49cf-84e5-aeb10d00eea8 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:46.632803 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e187-4a93-49cf-84e5-aeb10d00eea8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:46.633094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e187-4a93-49cf-84e5-aeb10d00eea8 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:46.634895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1206/2430] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:33:46.641322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ec848-52ad-4fae-9316-31ce8d3e3dcd None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:46.641769 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ec848-52ad-4fae-9316-31ce8d3e3dcd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:46.641868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ec848-52ad-4fae-9316-31ce8d3e3dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:46.660864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fc4ec848-52ad-4fae-9316-31ce8d3e3dcd None None] MFA Rules not processed for user `701c0e43cc30442582456f4f7153333a`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:33:46.662404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fc4ec848-52ad-4fae-9316-31ce8d3e3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:33:46.669425 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1225/2431] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:33:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:33:46.681586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e187-4a93-49cf-84e5-aeb10d00eea8 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:33:46.683448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3157e187-4a93-49cf-84e5-aeb10d00eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:33:46.698048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e187-4a93-49cf-84e5-aeb10d00eea8 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:33:46.701690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc61ff-a5f2-42b8-b776-02e7bf80500a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:33:46.702367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc61ff-a5f2-42b8-b776-02e7bf80500a service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:46.702649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc61ff-a5f2-42b8-b776-02e7bf80500a service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:46.702925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc61ff-a5f2-42b8-b776-02e7bf80500a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:46.710586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc61ff-a5f2-42b8-b776-02e7bf80500a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:33:46.712308 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc61ff-a5f2-42b8-b776-02e7bf80500a service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:33:46.720948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1207/2432] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:33:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:33:46.812091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f78b-3596-4c8e-8b9a-2b759655bb5e None None] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:46.812376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f78b-3596-4c8e-8b9a-2b759655bb5e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:46.812649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f78b-3596-4c8e-8b9a-2b759655bb5e None None] PATH_INFO: `/` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:46.814513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1226/2433] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:33:46.819828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516f4f-927a-4d22-a319-8b8bd4b9672e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:46.820122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516f4f-927a-4d22-a319-8b8bd4b9672e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:46.820407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516f4f-927a-4d22-a319-8b8bd4b9672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:46.838029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-f3516f4f-927a-4d22-a319-8b8bd4b9672e None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:33:46.839245 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f3516f4f-927a-4d22-a319-8b8bd4b9672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:33:46.848506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1208/2434] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:33:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:33:46.859015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f78b-3596-4c8e-8b9a-2b759655bb5e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:33:46.869841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f78b-3596-4c8e-8b9a-2b759655bb5e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:33:46.874070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee8b3f-a8b5-496b-92a9-28bdefbad4a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:33:46.874728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee8b3f-a8b5-496b-92a9-28bdefbad4a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:33:46.875015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee8b3f-a8b5-496b-92a9-28bdefbad4a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:33:46.875294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee8b3f-a8b5-496b-92a9-28bdefbad4a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:33:46.885205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee8b3f-a8b5-496b-92a9-28bdefbad4a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:33:46.886694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee8b3f-a8b5-496b-92a9-28bdefbad4a0 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:33:46.896965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1227/2435] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:33:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:34:33.057751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3516f4f-927a-4d22-a319-8b8bd4b9672e None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:33.066982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3516f4f-927a-4d22-a319-8b8bd4b9672e None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:33.070504 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cc13c-4fbb-4c82-af1b-0e711f61a2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:33.071132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cc13c-4fbb-4c82-af1b-0e711f61a2ed service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:33.071409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cc13c-4fbb-4c82-af1b-0e711f61a2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:33.071679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cc13c-4fbb-4c82-af1b-0e711f61a2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:33.073412 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8f6cc13c-4fbb-4c82-af1b-0e711f61a2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:33.132302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cc13c-4fbb-4c82-af1b-0e711f61a2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:33.133716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cc13c-4fbb-4c82-af1b-0e711f61a2ed service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:33.143482 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1209/2436] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:34:36.336426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee8b3f-a8b5-496b-92a9-28bdefbad4a0 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:36.337936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c2ee8b3f-a8b5-496b-92a9-28bdefbad4a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:36.351760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee8b3f-a8b5-496b-92a9-28bdefbad4a0 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:36.356451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:36.357330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:36.357590 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:36.357856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] PATH_INFO: `/v3/users/9dbdadbe21e542dcb1c3dad9d67e8a92` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:36.371279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbdadbe21e542dcb1c3dad9d67e8a92)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:36.373134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:36.415841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbdadbe21e542dcb1c3dad9d67e8a92'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.422826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbdadbe21e542dcb1c3dad9d67e8a92'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.429724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbdadbe21e542dcb1c3dad9d67e8a92'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.430377 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbdadbe21e542dcb1c3dad9d67e8a92'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.430972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-de1d899c-38ba-4b8b-a71f-6102e3fe8c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbdadbe21e542dcb1c3dad9d67e8a92'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.447587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1228/2437] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:34:36 2022] DELETE /identity/v3/users/9dbdadbe21e542dcb1c3dad9d67e8a92 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:36.609552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cc13c-4fbb-4c82-af1b-0e711f61a2ed service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:36.619413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cc13c-4fbb-4c82-af1b-0e711f61a2ed service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:36.677770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:36.678668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:36.678958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:36.679235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] PATH_INFO: `/v3/projects/6eb73c579cdb40bd843d4e19a535f2ae` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:36.689548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb73c579cdb40bd843d4e19a535f2ae)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:36.691491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:36.735272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb73c579cdb40bd843d4e19a535f2ae', 'request_id': 'req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.741557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb73c579cdb40bd843d4e19a535f2ae', 'request_id': 'req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.749004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb73c579cdb40bd843d4e19a535f2ae', 'request_id': 'req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.758949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] The token cache is being invalidate because project 6eb73c579cdb40bd843d4e19a535f2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:34:36.759237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.759859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-575178b7-8e6a-45a1-a5dc-276f9e3f57f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:36.761364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1210/2438] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:34:36 2022] DELETE /identity/v3/projects/6eb73c579cdb40bd843d4e19a535f2ae => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:36.767139 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a939e2-6e46-4111-8167-2b34183d96ae None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:36.767467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a939e2-6e46-4111-8167-2b34183d96ae None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:36.767751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a939e2-6e46-4111-8167-2b34183d96ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:36.785531 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-a0a939e2-6e46-4111-8167-2b34183d96ae None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:34:36.786766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-a0a939e2-6e46-4111-8167-2b34183d96ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:36.846348 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1229/2439] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:34:36.854664 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af69d5f-2510-4785-b55f-18355f621228 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:36.854950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af69d5f-2510-4785-b55f-18355f621228 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:36.855226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af69d5f-2510-4785-b55f-18355f621228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:36.874209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-2af69d5f-2510-4785-b55f-18355f621228 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:34:36.875382 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-2af69d5f-2510-4785-b55f-18355f621228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:36.883353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1211/2440] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:34:36.888202 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a939e2-6e46-4111-8167-2b34183d96ae None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:36.898672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a939e2-6e46-4111-8167-2b34183d96ae None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:36.903219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493f810-5df7-487a-abe1-17fa49b94f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:36.903873 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493f810-5df7-487a-abe1-17fa49b94f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:36.904157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493f810-5df7-487a-abe1-17fa49b94f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:36.904434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493f810-5df7-487a-abe1-17fa49b94f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:36.905152 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493f810-5df7-487a-abe1-17fa49b94f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:34:36.905455 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493f810-5df7-487a-abe1-17fa49b94f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:36.907068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493f810-5df7-487a-abe1-17fa49b94f42 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:36.918675 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1230/2441] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:34:36.923076 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af69d5f-2510-4785-b55f-18355f621228 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:36.932052 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af69d5f-2510-4785-b55f-18355f621228 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:36.937388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f546-272b-43f6-88d9-e724f22c4742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:36.938020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f546-272b-43f6-88d9-e724f22c4742 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:36.938337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f546-272b-43f6-88d9-e724f22c4742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:36.938609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f546-272b-43f6-88d9-e724f22c4742 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:36.939292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6f546-272b-43f6-88d9-e724f22c4742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:36.941226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6f546-272b-43f6-88d9-e724f22c4742 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:36.974256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1212/2442] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:34:36 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:34:36.978344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493f810-5df7-487a-abe1-17fa49b94f42 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:36.988435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493f810-5df7-487a-abe1-17fa49b94f42 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.043852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca20ad1-1ca8-41ac-b554-f2922438a7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.044525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca20ad1-1ca8-41ac-b554-f2922438a7be admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.044806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca20ad1-1ca8-41ac-b554-f2922438a7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.045085 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca20ad1-1ca8-41ac-b554-f2922438a7be admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.045766 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca20ad1-1ca8-41ac-b554-f2922438a7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.047731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca20ad1-1ca8-41ac-b554-f2922438a7be admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.068868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1231/2443] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:34:36 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:34:37.072972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f546-272b-43f6-88d9-e724f22c4742 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.083603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f546-272b-43f6-88d9-e724f22c4742 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.088288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e526a-c99f-44cc-a1b2-3e0a115767ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.088940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e526a-c99f-44cc-a1b2-3e0a115767ec admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.089223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e526a-c99f-44cc-a1b2-3e0a115767ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.089494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e526a-c99f-44cc-a1b2-3e0a115767ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.090295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e526a-c99f-44cc-a1b2-3e0a115767ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.091895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e526a-c99f-44cc-a1b2-3e0a115767ec admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.101516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1213/2444] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:34:37.105506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca20ad1-1ca8-41ac-b554-f2922438a7be admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.116395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca20ad1-1ca8-41ac-b554-f2922438a7be admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.121094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35e703-2975-41ec-9fcc-ec001833f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.122375 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35e703-2975-41ec-9fcc-ec001833f583 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.122662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35e703-2975-41ec-9fcc-ec001833f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.124067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35e703-2975-41ec-9fcc-ec001833f583 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.124067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35e703-2975-41ec-9fcc-ec001833f583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.125265 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35e703-2975-41ec-9fcc-ec001833f583 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.139394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1232/2445] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:34:37.141622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e526a-c99f-44cc-a1b2-3e0a115767ec admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.151850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e526a-c99f-44cc-a1b2-3e0a115767ec admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.156489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434bcc-599a-43bc-b3fc-45ae44572443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.157365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434bcc-599a-43bc-b3fc-45ae44572443 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.157649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434bcc-599a-43bc-b3fc-45ae44572443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.157924 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434bcc-599a-43bc-b3fc-45ae44572443 admin admin] PATH_INFO: `/v3/projects/95a3d739432c4f32b4368ad7543aac95/users/a3a589d325874534bfbb5701fc629f63/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.172551 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8434bcc-599a-43bc-b3fc-45ae44572443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a3d739432c4f32b4368ad7543aac95, user_id=a3a589d325874534bfbb5701fc629f63, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.175236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8434bcc-599a-43bc-b3fc-45ae44572443 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.188466 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1214/2446] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:34:37 2022] PUT /identity/v3/projects/95a3d739432c4f32b4368ad7543aac95/users/a3a589d325874534bfbb5701fc629f63/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:37.198360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5aa0b-aa10-4ea4-a2bd-32b709ce37bf None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.198655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5aa0b-aa10-4ea4-a2bd-32b709ce37bf None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.198935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5aa0b-aa10-4ea4-a2bd-32b709ce37bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.224620 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-6de5aa0b-aa10-4ea4-a2bd-32b709ce37bf None None] MFA Rules not processed for user `a3a589d325874534bfbb5701fc629f63`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:34:37.225809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6de5aa0b-aa10-4ea4-a2bd-32b709ce37bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:37.286444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1233/2447] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:34:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:34:37.290960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434bcc-599a-43bc-b3fc-45ae44572443 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.349375 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434bcc-599a-43bc-b3fc-45ae44572443 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.353901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fbef2-369b-404d-b6c6-07dcea73a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.354578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fbef2-369b-404d-b6c6-07dcea73a8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.354861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fbef2-369b-404d-b6c6-07dcea73a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.355131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fbef2-369b-404d-b6c6-07dcea73a8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.356387 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fbef2-369b-404d-b6c6-07dcea73a8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.358292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fbef2-369b-404d-b6c6-07dcea73a8e6 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.382844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1215/2448] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:34:37 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:34:37.386995 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5aa0b-aa10-4ea4-a2bd-32b709ce37bf None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.398157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5aa0b-aa10-4ea4-a2bd-32b709ce37bf None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.453301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdc0eb-2845-43a0-8e08-3b993c6846a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.453983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdc0eb-2845-43a0-8e08-3b993c6846a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.454305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdc0eb-2845-43a0-8e08-3b993c6846a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.454587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdc0eb-2845-43a0-8e08-3b993c6846a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.455283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdc0eb-2845-43a0-8e08-3b993c6846a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.457175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdc0eb-2845-43a0-8e08-3b993c6846a0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.477575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1234/2449] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:34:37 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:34:37.482591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fbef2-369b-404d-b6c6-07dcea73a8e6 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.493491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fbef2-369b-404d-b6c6-07dcea73a8e6 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.498793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a5830-8be5-4011-9339-e5bdcb2511a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.499450 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a5830-8be5-4011-9339-e5bdcb2511a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.499729 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a5830-8be5-4011-9339-e5bdcb2511a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.500004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a5830-8be5-4011-9339-e5bdcb2511a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.500727 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a5830-8be5-4011-9339-e5bdcb2511a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.502345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a5830-8be5-4011-9339-e5bdcb2511a5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.512563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1216/2450] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:34:37.516838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdc0eb-2845-43a0-8e08-3b993c6846a0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.526783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdc0eb-2845-43a0-8e08-3b993c6846a0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.531826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd4639-5a9a-4fcf-8c20-38ccec789b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.532695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd4639-5a9a-4fcf-8c20-38ccec789b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.532976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd4639-5a9a-4fcf-8c20-38ccec789b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.533248 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd4639-5a9a-4fcf-8c20-38ccec789b42 admin admin] PATH_INFO: `/v3/projects/fca6caaf25444dae9899dbeed5b6ac78/users/6f16bdb748194cd0966635ee39437ce3/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.547788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd4639-5a9a-4fcf-8c20-38ccec789b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca6caaf25444dae9899dbeed5b6ac78, user_id=6f16bdb748194cd0966635ee39437ce3, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.550641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd4639-5a9a-4fcf-8c20-38ccec789b42 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.563998 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1235/2451] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:34:37 2022] PUT /identity/v3/projects/fca6caaf25444dae9899dbeed5b6ac78/users/6f16bdb748194cd0966635ee39437ce3/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:37.567963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a5830-8be5-4011-9339-e5bdcb2511a5 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.578204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a5830-8be5-4011-9339-e5bdcb2511a5 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.630276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f72e90-2a4e-4351-9605-0e42ba184123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.630928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f72e90-2a4e-4351-9605-0e42ba184123 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.631217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f72e90-2a4e-4351-9605-0e42ba184123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.631511 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f72e90-2a4e-4351-9605-0e42ba184123 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.632333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f72e90-2a4e-4351-9605-0e42ba184123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.633916 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f72e90-2a4e-4351-9605-0e42ba184123 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.643823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1217/2452] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:34:37.648251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd4639-5a9a-4fcf-8c20-38ccec789b42 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.658270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd4639-5a9a-4fcf-8c20-38ccec789b42 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.662823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c64b8-281a-4137-a5aa-bd2e81d14914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.663682 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c64b8-281a-4137-a5aa-bd2e81d14914 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.663960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c64b8-281a-4137-a5aa-bd2e81d14914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.664233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c64b8-281a-4137-a5aa-bd2e81d14914 admin admin] PATH_INFO: `/v3/projects/fca6caaf25444dae9899dbeed5b6ac78/users/6f16bdb748194cd0966635ee39437ce3/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.666233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c64b8-281a-4137-a5aa-bd2e81d14914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca6caaf25444dae9899dbeed5b6ac78, user_id=6f16bdb748194cd0966635ee39437ce3, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.669289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c64b8-281a-4137-a5aa-bd2e81d14914 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.679106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1236/2453] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:34:37 2022] PUT /identity/v3/projects/fca6caaf25444dae9899dbeed5b6ac78/users/6f16bdb748194cd0966635ee39437ce3/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:34:37.690381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869306e9-7e4a-4f57-a206-e2feefa9241f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.690670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869306e9-7e4a-4f57-a206-e2feefa9241f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.690947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869306e9-7e4a-4f57-a206-e2feefa9241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.718280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-869306e9-7e4a-4f57-a206-e2feefa9241f None None] MFA Rules not processed for user `6f16bdb748194cd0966635ee39437ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:34:37.719459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-869306e9-7e4a-4f57-a206-e2feefa9241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:37.791400 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1218/2454] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:34:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:34:37.802042 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c64b8-281a-4137-a5aa-bd2e81d14914 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:37.803804 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-168c64b8-281a-4137-a5aa-bd2e81d14914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:37.858677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c64b8-281a-4137-a5aa-bd2e81d14914 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:37.862306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7f047-9f2e-432d-9c2b-d4cb6f776843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:37.862937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f047-9f2e-432d-9c2b-d4cb6f776843 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:37.863220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f047-9f2e-432d-9c2b-d4cb6f776843 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:37.863494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f047-9f2e-432d-9c2b-d4cb6f776843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:37.872106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7f047-9f2e-432d-9c2b-d4cb6f776843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:37.873519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7f047-9f2e-432d-9c2b-d4cb6f776843 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:37.882547 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1237/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:34:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:34:39.142186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869306e9-7e4a-4f57-a206-e2feefa9241f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:39.201364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869306e9-7e4a-4f57-a206-e2feefa9241f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:39.205714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:39.206602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:39.206882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:39.207156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] PATH_INFO: `/v3/users/a3a589d325874534bfbb5701fc629f63` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:39.208315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a589d325874534bfbb5701fc629f63)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:39.210253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:39.252012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a589d325874534bfbb5701fc629f63'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.258781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a589d325874534bfbb5701fc629f63'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.259383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a589d325874534bfbb5701fc629f63'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.266850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a589d325874534bfbb5701fc629f63'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.279014 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a589d325874534bfbb5701fc629f63'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.284701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1219/2456] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:34:39 2022] DELETE /identity/v3/users/a3a589d325874534bfbb5701fc629f63 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:39.289198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463941e-7fbc-4aa4-8aea-d56b4a893ad1 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:39.289663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463941e-7fbc-4aa4-8aea-d56b4a893ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:39.289840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463941e-7fbc-4aa4-8aea-d56b4a893ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:39.307034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-1463941e-7fbc-4aa4-8aea-d56b4a893ad1 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:34:39.308219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1463941e-7fbc-4aa4-8aea-d56b4a893ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:39.365027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1238/2457] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:34:39.374767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:39.376270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:39.431272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85072477-34db-4d85-bb9a-f016ae611df9 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:39.435393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b33d6a-4f78-4b51-bc08-d7881c2d1de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:39.436028 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b33d6a-4f78-4b51-bc08-d7881c2d1de6 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:39.436312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b33d6a-4f78-4b51-bc08-d7881c2d1de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:39.436585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b33d6a-4f78-4b51-bc08-d7881c2d1de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:39.445321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b33d6a-4f78-4b51-bc08-d7881c2d1de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:39.446777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b33d6a-4f78-4b51-bc08-d7881c2d1de6 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:39.456527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1220/2458] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:34:39.718185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463941e-7fbc-4aa4-8aea-d56b4a893ad1 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:39.719774 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-1463941e-7fbc-4aa4-8aea-d56b4a893ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:39.732947 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463941e-7fbc-4aa4-8aea-d56b4a893ad1 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:39.737430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:39.738340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:39.738621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:39.738897 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] PATH_INFO: `/v3/projects/95a3d739432c4f32b4368ad7543aac95` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:39.740064 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a3d739432c4f32b4368ad7543aac95)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:39.742715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:39.787466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a3d739432c4f32b4368ad7543aac95', 'request_id': 'req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.794758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a3d739432c4f32b4368ad7543aac95', 'request_id': 'req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.800617 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a3d739432c4f32b4368ad7543aac95', 'request_id': 'req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.810706 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] The token cache is being invalidate because project 95a3d739432c4f32b4368ad7543aac95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:34:39.811020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.815957 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.817647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1239/2459] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:34:39 2022] DELETE /identity/v3/projects/95a3d739432c4f32b4368ad7543aac95 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:39.821425 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b33d6a-4f78-4b51-bc08-d7881c2d1de6 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:39.831337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b33d6a-4f78-4b51-bc08-d7881c2d1de6 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:39.883518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:39.884380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:39.884662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:39.884935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] PATH_INFO: `/v3/users/6f16bdb748194cd0966635ee39437ce3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:39.886096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f16bdb748194cd0966635ee39437ce3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:39.888603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:39.932837 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f16bdb748194cd0966635ee39437ce3'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.939185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f16bdb748194cd0966635ee39437ce3'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.939794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f16bdb748194cd0966635ee39437ce3'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.946478 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f16bdb748194cd0966635ee39437ce3'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.958271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ff96479b-a6f8-46e6-b289-5d561ad1069f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f16bdb748194cd0966635ee39437ce3'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:39.963976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1221/2460] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:34:39 2022] DELETE /identity/v3/users/6f16bdb748194cd0966635ee39437ce3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:40.217692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:40.219227 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:40.231985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0c2c1-4d8a-4ee7-b3e3-7b73a99fc9c6 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:40.286733 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:40.287587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.287867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.288141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] PATH_INFO: `/v3/projects/fca6caaf25444dae9899dbeed5b6ac78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.289311 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca6caaf25444dae9899dbeed5b6ac78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:40.291234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:40.335484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca6caaf25444dae9899dbeed5b6ac78', 'request_id': 'req-420e3323-649c-420a-a570-37a6566093c5'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:40.342569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca6caaf25444dae9899dbeed5b6ac78', 'request_id': 'req-420e3323-649c-420a-a570-37a6566093c5'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:40.348529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca6caaf25444dae9899dbeed5b6ac78', 'request_id': 'req-420e3323-649c-420a-a570-37a6566093c5'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:40.358629 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] The token cache is being invalidate because project fca6caaf25444dae9899dbeed5b6ac78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:34:40.358917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:40.359540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-420e3323-649c-420a-a570-37a6566093c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:34:40.361071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1240/2461] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:34:40 2022] DELETE /identity/v3/projects/fca6caaf25444dae9899dbeed5b6ac78 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:40.366156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1874e3-653e-4de5-bfb4-be56e98ddf6f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.366623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1874e3-653e-4de5-bfb4-be56e98ddf6f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.366739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1874e3-653e-4de5-bfb4-be56e98ddf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.385060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-5f1874e3-653e-4de5-bfb4-be56e98ddf6f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:34:40.386298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5f1874e3-653e-4de5-bfb4-be56e98ddf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:40.443977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1222/2462] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:34:40.451916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95246d12-5116-4fa7-aa47-d591b1d113c1 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.452204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95246d12-5116-4fa7-aa47-d591b1d113c1 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.452481 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95246d12-5116-4fa7-aa47-d591b1d113c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.470578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-95246d12-5116-4fa7-aa47-d591b1d113c1 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:34:40.471756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-95246d12-5116-4fa7-aa47-d591b1d113c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:40.479818 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1241/2463] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:34:40.484453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1874e3-653e-4de5-bfb4-be56e98ddf6f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:40.493787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1874e3-653e-4de5-bfb4-be56e98ddf6f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:40.498424 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6eb015-b6d8-45ad-a1ad-30298c49406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:40.499071 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6eb015-b6d8-45ad-a1ad-30298c49406b admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.499357 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6eb015-b6d8-45ad-a1ad-30298c49406b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.499635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6eb015-b6d8-45ad-a1ad-30298c49406b admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.500356 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6eb015-b6d8-45ad-a1ad-30298c49406b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:34:40.500665 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6eb015-b6d8-45ad-a1ad-30298c49406b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:40.502286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6eb015-b6d8-45ad-a1ad-30298c49406b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:40.513301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1223/2464] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:34:40.517484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95246d12-5116-4fa7-aa47-d591b1d113c1 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:40.526841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95246d12-5116-4fa7-aa47-d591b1d113c1 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:40.532001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430fb0-3506-4004-a4b1-ab8fbd0b0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:40.532643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430fb0-3506-4004-a4b1-ab8fbd0b0163 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.532950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430fb0-3506-4004-a4b1-ab8fbd0b0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.533251 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430fb0-3506-4004-a4b1-ab8fbd0b0163 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.533936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3430fb0-3506-4004-a4b1-ab8fbd0b0163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:40.535852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3430fb0-3506-4004-a4b1-ab8fbd0b0163 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:40.560885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1242/2465] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:34:40 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:34:40.564951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6eb015-b6d8-45ad-a1ad-30298c49406b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:40.575298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6eb015-b6d8-45ad-a1ad-30298c49406b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:40.628964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff90149-e4f2-4fce-a9de-20875c329665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:40.629621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff90149-e4f2-4fce-a9de-20875c329665 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.629912 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff90149-e4f2-4fce-a9de-20875c329665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.630224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff90149-e4f2-4fce-a9de-20875c329665 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.630927 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff90149-e4f2-4fce-a9de-20875c329665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:40.632904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff90149-e4f2-4fce-a9de-20875c329665 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:40.651274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1224/2466] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:34:40 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:34:40.655484 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430fb0-3506-4004-a4b1-ab8fbd0b0163 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:40.665340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430fb0-3506-4004-a4b1-ab8fbd0b0163 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:40.670669 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698bb88-e76e-4872-a624-a6cce4b652c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:40.671378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698bb88-e76e-4872-a624-a6cce4b652c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.671659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698bb88-e76e-4872-a624-a6cce4b652c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.671933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698bb88-e76e-4872-a624-a6cce4b652c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.672642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698bb88-e76e-4872-a624-a6cce4b652c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:40.674247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698bb88-e76e-4872-a624-a6cce4b652c7 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:40.684841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1243/2467] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:34:40.688663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff90149-e4f2-4fce-a9de-20875c329665 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:40.698353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff90149-e4f2-4fce-a9de-20875c329665 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:40.703007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44cb14-f583-40d6-a06b-738d5bab2297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:40.703649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44cb14-f583-40d6-a06b-738d5bab2297 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.703960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44cb14-f583-40d6-a06b-738d5bab2297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.704241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44cb14-f583-40d6-a06b-738d5bab2297 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.704958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44cb14-f583-40d6-a06b-738d5bab2297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:40.706590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44cb14-f583-40d6-a06b-738d5bab2297 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:40.716850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1225/2468] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:34:40.720291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698bb88-e76e-4872-a624-a6cce4b652c7 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:40.729859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698bb88-e76e-4872-a624-a6cce4b652c7 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:40.736031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712082-dd47-48df-9aeb-cd9ebb137f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:40.736928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712082-dd47-48df-9aeb-cd9ebb137f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.737209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712082-dd47-48df-9aeb-cd9ebb137f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.737481 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712082-dd47-48df-9aeb-cd9ebb137f8c admin admin] PATH_INFO: `/v3/projects/38a7f69ffcad40fe936e666b270ad67e/users/0a4724b6cf4d4314baed1d784f151ad5/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.751534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05712082-dd47-48df-9aeb-cd9ebb137f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a7f69ffcad40fe936e666b270ad67e, user_id=0a4724b6cf4d4314baed1d784f151ad5, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:40.754154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05712082-dd47-48df-9aeb-cd9ebb137f8c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:40.767462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1244/2469] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:34:40 2022] PUT /identity/v3/projects/38a7f69ffcad40fe936e666b270ad67e/users/0a4724b6cf4d4314baed1d784f151ad5/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:34:40.779048 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b16210-9505-42a1-a884-b99f6b1ea2c2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.779366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b16210-9505-42a1-a884-b99f6b1ea2c2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.779640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b16210-9505-42a1-a884-b99f6b1ea2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.805587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-03b16210-9505-42a1-a884-b99f6b1ea2c2 None None] MFA Rules not processed for user `0a4724b6cf4d4314baed1d784f151ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:34:40.806811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-03b16210-9505-42a1-a884-b99f6b1ea2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:40.866669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1226/2470] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:34:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:34:40.872345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712082-dd47-48df-9aeb-cd9ebb137f8c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:40.930932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712082-dd47-48df-9aeb-cd9ebb137f8c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:40.936445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc803f-7483-4e24-866c-1d62909a114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:40.937140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc803f-7483-4e24-866c-1d62909a114a admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:40.937406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc803f-7483-4e24-866c-1d62909a114a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:40.937687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc803f-7483-4e24-866c-1d62909a114a admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:40.938420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc803f-7483-4e24-866c-1d62909a114a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:40.940352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc803f-7483-4e24-866c-1d62909a114a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:40.965479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1245/2471] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:34:40 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:34:40.969161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b16210-9505-42a1-a884-b99f6b1ea2c2 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:40.979635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b16210-9505-42a1-a884-b99f6b1ea2c2 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:41.034956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220e007-21f6-4ed1-a46f-eb627fd11cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:41.035628 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220e007-21f6-4ed1-a46f-eb627fd11cee admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:41.035909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220e007-21f6-4ed1-a46f-eb627fd11cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:41.036182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220e007-21f6-4ed1-a46f-eb627fd11cee admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:41.036852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220e007-21f6-4ed1-a46f-eb627fd11cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:41.038800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220e007-21f6-4ed1-a46f-eb627fd11cee admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:41.057953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1227/2472] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:34:40 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:34:41.062589 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc803f-7483-4e24-866c-1d62909a114a admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:41.072761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc803f-7483-4e24-866c-1d62909a114a admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:41.077854 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075fd15-c851-4de8-947a-bd95e5cf60ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:41.078551 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075fd15-c851-4de8-947a-bd95e5cf60ff admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:41.078837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075fd15-c851-4de8-947a-bd95e5cf60ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:41.079113 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075fd15-c851-4de8-947a-bd95e5cf60ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:41.079827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075fd15-c851-4de8-947a-bd95e5cf60ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:41.081409 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075fd15-c851-4de8-947a-bd95e5cf60ff admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:41.091709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1246/2473] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:34:41.095618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220e007-21f6-4ed1-a46f-eb627fd11cee admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:41.105079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220e007-21f6-4ed1-a46f-eb627fd11cee admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:41.109818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80f641-968b-427a-88ba-5e29b8c70b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:41.110800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80f641-968b-427a-88ba-5e29b8c70b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:41.111087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80f641-968b-427a-88ba-5e29b8c70b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:41.111388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80f641-968b-427a-88ba-5e29b8c70b9d admin admin] PATH_INFO: `/v3/projects/9a4ba68d4728486ca425068fb90eb1f7/users/7b65e64e749941e8aa85ccdda6ec27d4/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:41.126183 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80f641-968b-427a-88ba-5e29b8c70b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4ba68d4728486ca425068fb90eb1f7, user_id=7b65e64e749941e8aa85ccdda6ec27d4, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:41.128783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80f641-968b-427a-88ba-5e29b8c70b9d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:41.141853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1228/2474] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:34:41 2022] PUT /identity/v3/projects/9a4ba68d4728486ca425068fb90eb1f7/users/7b65e64e749941e8aa85ccdda6ec27d4/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:41.145628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075fd15-c851-4de8-947a-bd95e5cf60ff admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:41.155725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075fd15-c851-4de8-947a-bd95e5cf60ff admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:41.209315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43f9a3-d27f-40d8-8b0e-7a37692fed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:41.209984 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43f9a3-d27f-40d8-8b0e-7a37692fed52 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:41.210408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43f9a3-d27f-40d8-8b0e-7a37692fed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:41.210691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43f9a3-d27f-40d8-8b0e-7a37692fed52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:41.211430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43f9a3-d27f-40d8-8b0e-7a37692fed52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:41.213041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43f9a3-d27f-40d8-8b0e-7a37692fed52 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:41.222576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1247/2475] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:34:41.226655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80f641-968b-427a-88ba-5e29b8c70b9d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:41.236448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80f641-968b-427a-88ba-5e29b8c70b9d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:41.240940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b54b8-2430-4b40-9ee7-fcf5a12c0884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:41.241796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b54b8-2430-4b40-9ee7-fcf5a12c0884 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:41.242077 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b54b8-2430-4b40-9ee7-fcf5a12c0884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:41.242383 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b54b8-2430-4b40-9ee7-fcf5a12c0884 admin admin] PATH_INFO: `/v3/projects/9a4ba68d4728486ca425068fb90eb1f7/users/7b65e64e749941e8aa85ccdda6ec27d4/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:41.244347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b54b8-2430-4b40-9ee7-fcf5a12c0884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4ba68d4728486ca425068fb90eb1f7, user_id=7b65e64e749941e8aa85ccdda6ec27d4, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:41.247726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b54b8-2430-4b40-9ee7-fcf5a12c0884 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:41.257937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1229/2476] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:34:41 2022] PUT /identity/v3/projects/9a4ba68d4728486ca425068fb90eb1f7/users/7b65e64e749941e8aa85ccdda6ec27d4/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:34:41.268298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ea4f-0ea6-4075-bca6-2a79512141e4 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:41.268612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ea4f-0ea6-4075-bca6-2a79512141e4 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:41.268898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ea4f-0ea6-4075-bca6-2a79512141e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:41.295992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-d6c9ea4f-0ea6-4075-bca6-2a79512141e4 None None] MFA Rules not processed for user `7b65e64e749941e8aa85ccdda6ec27d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:34:41.297236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d6c9ea4f-0ea6-4075-bca6-2a79512141e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:41.362185 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1248/2477] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:34:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:34:41.373520 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b54b8-2430-4b40-9ee7-fcf5a12c0884 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:41.375314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-eb8b54b8-2430-4b40-9ee7-fcf5a12c0884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:34:41.429496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b54b8-2430-4b40-9ee7-fcf5a12c0884 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:41.433068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465b78a-2ce2-41ce-a353-61e9a3969eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:41.433716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465b78a-2ce2-41ce-a353-61e9a3969eca service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:41.434598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465b78a-2ce2-41ce-a353-61e9a3969eca service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:41.434874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465b78a-2ce2-41ce-a353-61e9a3969eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:41.486952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465b78a-2ce2-41ce-a353-61e9a3969eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:41.488375 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465b78a-2ce2-41ce-a353-61e9a3969eca service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:41.497563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1230/2478] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:34:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:34:48.111638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ea4f-0ea6-4075-bca6-2a79512141e4 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:34:48.120866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ea4f-0ea6-4075-bca6-2a79512141e4 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:34:48.124386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76031357-af44-487f-9666-9a6ecca3adfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:34:48.125022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76031357-af44-487f-9666-9a6ecca3adfd service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:34:48.125306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76031357-af44-487f-9666-9a6ecca3adfd service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:34:48.125584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76031357-af44-487f-9666-9a6ecca3adfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:34:48.134213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76031357-af44-487f-9666-9a6ecca3adfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:34:48.135628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76031357-af44-487f-9666-9a6ecca3adfd service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:34:48.145250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1249/2479] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:34:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:14.100300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465b78a-2ce2-41ce-a353-61e9a3969eca service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:14.101711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3465b78a-2ce2-41ce-a353-61e9a3969eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:14.112639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465b78a-2ce2-41ce-a353-61e9a3969eca service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:14.116226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6f089-656d-4142-86fc-131c835de3de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:14.116861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6f089-656d-4142-86fc-131c835de3de service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:14.117149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6f089-656d-4142-86fc-131c835de3de service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:14.117427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6f089-656d-4142-86fc-131c835de3de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:14.119208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bde6f089-656d-4142-86fc-131c835de3de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:14.175018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6f089-656d-4142-86fc-131c835de3de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:14.176442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6f089-656d-4142-86fc-131c835de3de service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:14.185634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1231/2480] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:20.977136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76031357-af44-487f-9666-9a6ecca3adfd service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:21.037137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76031357-af44-487f-9666-9a6ecca3adfd service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:21.041893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:21.043421 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:21.043706 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:21.043980 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] PATH_INFO: `/v3/users/0a4724b6cf4d4314baed1d784f151ad5` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:21.045158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4724b6cf4d4314baed1d784f151ad5)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:21.047098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:21.090519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4724b6cf4d4314baed1d784f151ad5'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.097025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4724b6cf4d4314baed1d784f151ad5'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.104021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4724b6cf4d4314baed1d784f151ad5'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.104710 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4724b6cf4d4314baed1d784f151ad5'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.105396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4724b6cf4d4314baed1d784f151ad5'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.121500 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1250/2481] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:35:20 2022] DELETE /identity/v3/users/0a4724b6cf4d4314baed1d784f151ad5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:21.125965 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7e0a-b7ae-4a4e-8fb5-17dd5acb7b92 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:21.126449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7e0a-b7ae-4a4e-8fb5-17dd5acb7b92 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:21.126567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7e0a-b7ae-4a4e-8fb5-17dd5acb7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:21.143921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-5ecf7e0a-b7ae-4a4e-8fb5-17dd5acb7b92 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:21.145107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5ecf7e0a-b7ae-4a4e-8fb5-17dd5acb7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:21.200401 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1232/2482] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:21.210009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:21.211460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:21.266460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1b3e6-5f0b-430a-90cd-9c531af83816 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:21.269985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961dec7-f97c-44d8-aa13-0bcdbb5f10f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:21.270649 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961dec7-f97c-44d8-aa13-0bcdbb5f10f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:21.270931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961dec7-f97c-44d8-aa13-0bcdbb5f10f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:21.271206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961dec7-f97c-44d8-aa13-0bcdbb5f10f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:21.280028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961dec7-f97c-44d8-aa13-0bcdbb5f10f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:21.281430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961dec7-f97c-44d8-aa13-0bcdbb5f10f2 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:21.290680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1251/2483] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:21.550122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf7e0a-b7ae-4a4e-8fb5-17dd5acb7b92 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:21.551573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5ecf7e0a-b7ae-4a4e-8fb5-17dd5acb7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:21.563156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf7e0a-b7ae-4a4e-8fb5-17dd5acb7b92 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:21.567730 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:21.568621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:21.568909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:21.569182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] PATH_INFO: `/v3/projects/38a7f69ffcad40fe936e666b270ad67e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:21.570954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a7f69ffcad40fe936e666b270ad67e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:21.572871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:21.618877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a7f69ffcad40fe936e666b270ad67e', 'request_id': 'req-c2aca579-7843-4ee2-aea2-0fd15470be43'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.624806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a7f69ffcad40fe936e666b270ad67e', 'request_id': 'req-c2aca579-7843-4ee2-aea2-0fd15470be43'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.631671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a7f69ffcad40fe936e666b270ad67e', 'request_id': 'req-c2aca579-7843-4ee2-aea2-0fd15470be43'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.641363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] The token cache is being invalidate because project 38a7f69ffcad40fe936e666b270ad67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:35:21.641650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.642305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.643822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1233/2484] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:35:21 2022] DELETE /identity/v3/projects/38a7f69ffcad40fe936e666b270ad67e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:21.647985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961dec7-f97c-44d8-aa13-0bcdbb5f10f2 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:21.657849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961dec7-f97c-44d8-aa13-0bcdbb5f10f2 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:21.710609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:21.711535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:21.711819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:21.712094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] PATH_INFO: `/v3/users/7b65e64e749941e8aa85ccdda6ec27d4` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:21.713275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b65e64e749941e8aa85ccdda6ec27d4)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:21.715784 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:21.758279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b65e64e749941e8aa85ccdda6ec27d4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.764714 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b65e64e749941e8aa85ccdda6ec27d4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.771628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b65e64e749941e8aa85ccdda6ec27d4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.772612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b65e64e749941e8aa85ccdda6ec27d4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.773269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-42822d8f-ef9d-4dff-8add-d40ac260b4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b65e64e749941e8aa85ccdda6ec27d4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:21.790223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1252/2485] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:35:21 2022] DELETE /identity/v3/users/7b65e64e749941e8aa85ccdda6ec27d4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:22.050618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.052016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:22.066700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca579-7843-4ee2-aea2-0fd15470be43 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.121246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.122126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.122419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.122697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] PATH_INFO: `/v3/projects/9a4ba68d4728486ca425068fb90eb1f7` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.123880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4ba68d4728486ca425068fb90eb1f7)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.125794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.170225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4ba68d4728486ca425068fb90eb1f7', 'request_id': 'req-72e90f92-7986-4dce-909d-e751fd9b155e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:22.176046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4ba68d4728486ca425068fb90eb1f7', 'request_id': 'req-72e90f92-7986-4dce-909d-e751fd9b155e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:22.182776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4ba68d4728486ca425068fb90eb1f7', 'request_id': 'req-72e90f92-7986-4dce-909d-e751fd9b155e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:22.193094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] The token cache is being invalidate because project 9a4ba68d4728486ca425068fb90eb1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:35:22.193381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:22.193996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72e90f92-7986-4dce-909d-e751fd9b155e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:22.195530 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1234/2486] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:35:22 2022] DELETE /identity/v3/projects/9a4ba68d4728486ca425068fb90eb1f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:22.201074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d763956-150f-4a85-b1bd-5a98f9a2a5f5 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.201517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d763956-150f-4a85-b1bd-5a98f9a2a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.201728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d763956-150f-4a85-b1bd-5a98f9a2a5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.220855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-5d763956-150f-4a85-b1bd-5a98f9a2a5f5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:22.221167 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-5d763956-150f-4a85-b1bd-5a98f9a2a5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:22.276518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1253/2487] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:22.284398 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ab83-d89a-421d-92bf-59a2373c73e7 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.284778 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ab83-d89a-421d-92bf-59a2373c73e7 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.285062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ab83-d89a-421d-92bf-59a2373c73e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.303029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-4b92ab83-d89a-421d-92bf-59a2373c73e7 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:22.304149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-4b92ab83-d89a-421d-92bf-59a2373c73e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:22.312565 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1235/2488] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:22.316821 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d763956-150f-4a85-b1bd-5a98f9a2a5f5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.327175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d763956-150f-4a85-b1bd-5a98f9a2a5f5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.331689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35e50-6d05-439e-932a-648a269bd0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.332334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35e50-6d05-439e-932a-648a269bd0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.332613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35e50-6d05-439e-932a-648a269bd0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.332886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35e50-6d05-439e-932a-648a269bd0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.333598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35e50-6d05-439e-932a-648a269bd0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:35:22.333902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35e50-6d05-439e-932a-648a269bd0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.335508 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35e50-6d05-439e-932a-648a269bd0ad admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.346535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1254/2489] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:35:22.350947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92ab83-d89a-421d-92bf-59a2373c73e7 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.359936 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92ab83-d89a-421d-92bf-59a2373c73e7 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.364502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac60e34-ddf9-4764-97b9-6556b703c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.365164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac60e34-ddf9-4764-97b9-6556b703c90c admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.365448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac60e34-ddf9-4764-97b9-6556b703c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.365724 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac60e34-ddf9-4764-97b9-6556b703c90c admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.366439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac60e34-ddf9-4764-97b9-6556b703c90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.368323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac60e34-ddf9-4764-97b9-6556b703c90c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.393134 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1236/2490] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:35:22 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:35:22.397514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35e50-6d05-439e-932a-648a269bd0ad admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.407276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35e50-6d05-439e-932a-648a269bd0ad admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.460999 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec1442-9161-45ba-831a-52900db1a947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.461662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1442-9161-45ba-831a-52900db1a947 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.461950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1442-9161-45ba-831a-52900db1a947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.462273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1442-9161-45ba-831a-52900db1a947 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.462954 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec1442-9161-45ba-831a-52900db1a947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.464907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec1442-9161-45ba-831a-52900db1a947 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.484668 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1255/2491] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:35:22 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:35:22.488716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac60e34-ddf9-4764-97b9-6556b703c90c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.499256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac60e34-ddf9-4764-97b9-6556b703c90c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.503790 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc956a-15e8-440c-b450-aeb56cee96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.504440 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc956a-15e8-440c-b450-aeb56cee96b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.504724 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc956a-15e8-440c-b450-aeb56cee96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.505002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc956a-15e8-440c-b450-aeb56cee96b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.505717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc956a-15e8-440c-b450-aeb56cee96b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.507386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc956a-15e8-440c-b450-aeb56cee96b6 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.517459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1237/2492] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:35:22.522691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec1442-9161-45ba-831a-52900db1a947 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.533131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec1442-9161-45ba-831a-52900db1a947 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.537671 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b5346-407d-4b51-aba7-f9c84658b3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.538362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b5346-407d-4b51-aba7-f9c84658b3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.538651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b5346-407d-4b51-aba7-f9c84658b3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.538931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b5346-407d-4b51-aba7-f9c84658b3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.539705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b5346-407d-4b51-aba7-f9c84658b3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.541320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b5346-407d-4b51-aba7-f9c84658b3c0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.551521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1256/2493] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:35:22.555485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc956a-15e8-440c-b450-aeb56cee96b6 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.565056 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc956a-15e8-440c-b450-aeb56cee96b6 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.569627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2092f5-6ce8-4026-9e13-f50c7269f690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.570533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2092f5-6ce8-4026-9e13-f50c7269f690 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.570819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2092f5-6ce8-4026-9e13-f50c7269f690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.571097 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2092f5-6ce8-4026-9e13-f50c7269f690 admin admin] PATH_INFO: `/v3/projects/0595ce2c53a941ceb694f5fbfb00b897/users/5e2b05d12bd34f5dbb3bd2f65970b0af/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.586349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2092f5-6ce8-4026-9e13-f50c7269f690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0595ce2c53a941ceb694f5fbfb00b897, user_id=5e2b05d12bd34f5dbb3bd2f65970b0af, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.588986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2092f5-6ce8-4026-9e13-f50c7269f690 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.603126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1238/2494] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:35:22 2022] PUT /identity/v3/projects/0595ce2c53a941ceb694f5fbfb00b897/users/5e2b05d12bd34f5dbb3bd2f65970b0af/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:22.613067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aba9d-9cb4-4d5a-9c3a-d2b522e9c184 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.613364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aba9d-9cb4-4d5a-9c3a-d2b522e9c184 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.613646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aba9d-9cb4-4d5a-9c3a-d2b522e9c184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.639450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-7f1aba9d-9cb4-4d5a-9c3a-d2b522e9c184 None None] MFA Rules not processed for user `5e2b05d12bd34f5dbb3bd2f65970b0af`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:22.640647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7f1aba9d-9cb4-4d5a-9c3a-d2b522e9c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:22.701350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1257/2495] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:22.705652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2092f5-6ce8-4026-9e13-f50c7269f690 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.763374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2092f5-6ce8-4026-9e13-f50c7269f690 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.768009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97996206-41f4-4b20-885c-eeae579be7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.768653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996206-41f4-4b20-885c-eeae579be7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.768937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996206-41f4-4b20-885c-eeae579be7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.769210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996206-41f4-4b20-885c-eeae579be7f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.769879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97996206-41f4-4b20-885c-eeae579be7f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.771816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97996206-41f4-4b20-885c-eeae579be7f4 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.796557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1239/2496] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:35:22 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:35:22.799853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aba9d-9cb4-4d5a-9c3a-d2b522e9c184 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.810518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aba9d-9cb4-4d5a-9c3a-d2b522e9c184 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.864798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a86b01-3cfc-49f4-91c8-21023921838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.865465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a86b01-3cfc-49f4-91c8-21023921838b admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.865748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a86b01-3cfc-49f4-91c8-21023921838b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.866023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a86b01-3cfc-49f4-91c8-21023921838b admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.866752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a86b01-3cfc-49f4-91c8-21023921838b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.868658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a86b01-3cfc-49f4-91c8-21023921838b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.893339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1258/2497] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:35:22 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:35:22.894430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97996206-41f4-4b20-885c-eeae579be7f4 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.905460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97996206-41f4-4b20-885c-eeae579be7f4 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.909883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15fe33-f479-4ec6-bf51-b7b6a51f949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.910577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15fe33-f479-4ec6-bf51-b7b6a51f949b admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.910918 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15fe33-f479-4ec6-bf51-b7b6a51f949b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.911138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15fe33-f479-4ec6-bf51-b7b6a51f949b admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.911843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15fe33-f479-4ec6-bf51-b7b6a51f949b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.913432 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15fe33-f479-4ec6-bf51-b7b6a51f949b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.926133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1240/2498] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:35:22.928807 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a86b01-3cfc-49f4-91c8-21023921838b admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.939509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a86b01-3cfc-49f4-91c8-21023921838b admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:22.944120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f85a-1625-4cf0-84ce-24c73060a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:22.945035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f85a-1625-4cf0-84ce-24c73060a229 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:22.945320 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f85a-1625-4cf0-84ce-24c73060a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:22.945598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f85a-1625-4cf0-84ce-24c73060a229 admin admin] PATH_INFO: `/v3/projects/2f8d828f673e41d087e8badf623848ae/users/b2d56af9d10a43d0b75d883f7edbf44a/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:22.960285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8f85a-1625-4cf0-84ce-24c73060a229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d828f673e41d087e8badf623848ae, user_id=b2d56af9d10a43d0b75d883f7edbf44a, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:22.962948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8f85a-1625-4cf0-84ce-24c73060a229 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:22.975132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1259/2499] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:35:22 2022] PUT /identity/v3/projects/2f8d828f673e41d087e8badf623848ae/users/b2d56af9d10a43d0b75d883f7edbf44a/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:22.979051 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15fe33-f479-4ec6-bf51-b7b6a51f949b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:22.988851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15fe33-f479-4ec6-bf51-b7b6a51f949b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:23.043109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d8840-4dee-4ca6-bc6d-e2d1280999e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:23.043762 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8840-4dee-4ca6-bc6d-e2d1280999e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:23.044044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8840-4dee-4ca6-bc6d-e2d1280999e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:23.044317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8840-4dee-4ca6-bc6d-e2d1280999e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:23.045032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d8840-4dee-4ca6-bc6d-e2d1280999e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:23.046652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d8840-4dee-4ca6-bc6d-e2d1280999e5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:23.060815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1241/2500] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:35:23.065333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f85a-1625-4cf0-84ce-24c73060a229 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:23.076022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f85a-1625-4cf0-84ce-24c73060a229 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:23.080635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49cc34-f5e6-42ea-94ac-9a1c1c6c103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:23.081508 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49cc34-f5e6-42ea-94ac-9a1c1c6c103b admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:23.081795 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49cc34-f5e6-42ea-94ac-9a1c1c6c103b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:23.082076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49cc34-f5e6-42ea-94ac-9a1c1c6c103b admin admin] PATH_INFO: `/v3/projects/2f8d828f673e41d087e8badf623848ae/users/b2d56af9d10a43d0b75d883f7edbf44a/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:23.084060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49cc34-f5e6-42ea-94ac-9a1c1c6c103b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8d828f673e41d087e8badf623848ae, user_id=b2d56af9d10a43d0b75d883f7edbf44a, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:23.086713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49cc34-f5e6-42ea-94ac-9a1c1c6c103b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:23.096480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1260/2501] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:35:23 2022] PUT /identity/v3/projects/2f8d828f673e41d087e8badf623848ae/users/b2d56af9d10a43d0b75d883f7edbf44a/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:23.106505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3044a-7a7c-45d9-b9f8-73d6539a2955 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:23.106867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3044a-7a7c-45d9-b9f8-73d6539a2955 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:23.107154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3044a-7a7c-45d9-b9f8-73d6539a2955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:23.132763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-73b3044a-7a7c-45d9-b9f8-73d6539a2955 None None] MFA Rules not processed for user `b2d56af9d10a43d0b75d883f7edbf44a`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:23.134009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-73b3044a-7a7c-45d9-b9f8-73d6539a2955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:23.198483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1242/2502] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:35:23.210037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49cc34-f5e6-42ea-94ac-9a1c1c6c103b admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:23.211853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8e49cc34-f5e6-42ea-94ac-9a1c1c6c103b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:23.267235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49cc34-f5e6-42ea-94ac-9a1c1c6c103b admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:23.270850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eb8da-1d63-48a8-a5b3-67cf1c613f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:23.271492 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eb8da-1d63-48a8-a5b3-67cf1c613f22 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:23.271772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eb8da-1d63-48a8-a5b3-67cf1c613f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:23.272049 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eb8da-1d63-48a8-a5b3-67cf1c613f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:23.280939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eb8da-1d63-48a8-a5b3-67cf1c613f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:23.282371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eb8da-1d63-48a8-a5b3-67cf1c613f22 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:23.291451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1261/2503] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:23.338464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3044a-7a7c-45d9-b9f8-73d6539a2955 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:23.338911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-73b3044a-7a7c-45d9-b9f8-73d6539a2955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:23.350699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3044a-7a7c-45d9-b9f8-73d6539a2955 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:23.354347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d9a0-11d7-4e8a-9d25-d688c5ac20f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:23.355558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d9a0-11d7-4e8a-9d25-d688c5ac20f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:23.355844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d9a0-11d7-4e8a-9d25-d688c5ac20f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:23.356123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d9a0-11d7-4e8a-9d25-d688c5ac20f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:23.409999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26d9a0-11d7-4e8a-9d25-d688c5ac20f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:23.411459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26d9a0-11d7-4e8a-9d25-d688c5ac20f9 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:23.420523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1243/2504] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:26.615913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eb8da-1d63-48a8-a5b3-67cf1c613f22 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:26.681965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eb8da-1d63-48a8-a5b3-67cf1c613f22 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:26.687055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:26.687920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:26.688206 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:26.688488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] PATH_INFO: `/v3/users/5e2b05d12bd34f5dbb3bd2f65970b0af` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:26.689670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2b05d12bd34f5dbb3bd2f65970b0af)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:26.691619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:26.737347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2b05d12bd34f5dbb3bd2f65970b0af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:26.743898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2b05d12bd34f5dbb3bd2f65970b0af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:26.750884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2b05d12bd34f5dbb3bd2f65970b0af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:26.751605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2b05d12bd34f5dbb3bd2f65970b0af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:26.752221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2b05d12bd34f5dbb3bd2f65970b0af'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:26.769845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1262/2505] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:35:26 2022] DELETE /identity/v3/users/5e2b05d12bd34f5dbb3bd2f65970b0af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:26.774688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d51853-71c3-4a33-b89f-c8b1ad9ed04f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:26.775175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d51853-71c3-4a33-b89f-c8b1ad9ed04f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:26.775271 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d51853-71c3-4a33-b89f-c8b1ad9ed04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:26.792261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-53d51853-71c3-4a33-b89f-c8b1ad9ed04f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:26.793443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-53d51853-71c3-4a33-b89f-c8b1ad9ed04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:26.849386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1244/2506] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:26.859324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:26.860691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:26.914607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a9c40-9552-42f2-b3cb-0f4c12b4e0ec admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:26.918290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9cdba-8f50-419c-9812-8325f5596f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:26.918933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9cdba-8f50-419c-9812-8325f5596f94 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:26.919219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9cdba-8f50-419c-9812-8325f5596f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:26.919501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9cdba-8f50-419c-9812-8325f5596f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:26.928345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9cdba-8f50-419c-9812-8325f5596f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:26.929750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9cdba-8f50-419c-9812-8325f5596f94 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:26.939688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1263/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:35:27.180685 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f6eb0-0667-4b5b-9456-9a20029fe7c1 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:27.180978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f6eb0-0667-4b5b-9456-9a20029fe7c1 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:27.181397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f6eb0-0667-4b5b-9456-9a20029fe7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:27.200984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a18f6eb0-0667-4b5b-9456-9a20029fe7c1 None None] MFA Rules not processed for user `78bb6c03eb73430d9d208839a8fecf52`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:27.202498 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a18f6eb0-0667-4b5b-9456-9a20029fe7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:27.203102 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9cdba-8f50-419c-9812-8325f5596f94 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:27.204735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-53d9cdba-8f50-419c-9812-8325f5596f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:27.226228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9cdba-8f50-419c-9812-8325f5596f94 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:27.234683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:27.235535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:27.235815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:27.236087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] PATH_INFO: `/v3/projects/0595ce2c53a941ceb694f5fbfb00b897` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:27.237456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0595ce2c53a941ceb694f5fbfb00b897)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:27.239417 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:27.259822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1245/2508] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:35:27.285567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0595ce2c53a941ceb694f5fbfb00b897', 'request_id': 'req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.295204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f6eb0-0667-4b5b-9456-9a20029fe7c1 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:27.296968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a18f6eb0-0667-4b5b-9456-9a20029fe7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:27.297111 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0595ce2c53a941ceb694f5fbfb00b897', 'request_id': 'req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.303970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0595ce2c53a941ceb694f5fbfb00b897', 'request_id': 'req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.316106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] The token cache is being invalidate because project 0595ce2c53a941ceb694f5fbfb00b897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:35:27.316399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.317051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.318621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1264/2509] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:35:27 2022] DELETE /identity/v3/projects/0595ce2c53a941ceb694f5fbfb00b897 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:35:27.322457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:27.323767 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:27.352500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f6eb0-0667-4b5b-9456-9a20029fe7c1 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:27.384636 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fabf9-3a40-414c-b98b-58fa8e4c6ed0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:27.389181 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:27.390055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:27.390439 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:27.390717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] PATH_INFO: `/v3/users/b2d56af9d10a43d0b75d883f7edbf44a` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:27.391914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d56af9d10a43d0b75d883f7edbf44a)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:27.393846 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:27.401479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e20f2f-8fff-4b1c-8b6d-61cb4088dc16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:27.402268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20f2f-8fff-4b1c-8b6d-61cb4088dc16 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:27.402574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20f2f-8fff-4b1c-8b6d-61cb4088dc16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:27.402875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20f2f-8fff-4b1c-8b6d-61cb4088dc16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:27.404606 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f6e20f2f-8fff-4b1c-8b6d-61cb4088dc16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:27.441082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d56af9d10a43d0b75d883f7edbf44a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.447620 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d56af9d10a43d0b75d883f7edbf44a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.456463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d56af9d10a43d0b75d883f7edbf44a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.457121 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d56af9d10a43d0b75d883f7edbf44a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.458020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d56af9d10a43d0b75d883f7edbf44a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.476052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1265/2510] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:35:27 2022] DELETE /identity/v3/users/b2d56af9d10a43d0b75d883f7edbf44a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:27.479172 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e20f2f-8fff-4b1c-8b6d-61cb4088dc16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:27.481181 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e20f2f-8fff-4b1c-8b6d-61cb4088dc16 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:27.492111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1246/2511] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:35:27.814912 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:27.817093 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:27.883853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8546e-d11b-49ce-a2d7-c764a41e9144 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:27.888495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:27.889463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:27.889745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:27.890024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] PATH_INFO: `/v3/projects/2f8d828f673e41d087e8badf623848ae` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:27.891228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8d828f673e41d087e8badf623848ae)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:27.893112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:27.940190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8d828f673e41d087e8badf623848ae', 'request_id': 'req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.947090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8d828f673e41d087e8badf623848ae', 'request_id': 'req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.953448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8d828f673e41d087e8badf623848ae', 'request_id': 'req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.963891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] The token cache is being invalidate because project 2f8d828f673e41d087e8badf623848ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:35:27.964337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.964992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-f2ddefb6-2c57-45bf-83ca-0df17e3b4b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:27.966592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1266/2512] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:35:27 2022] DELETE /identity/v3/projects/2f8d828f673e41d087e8badf623848ae => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:27.971557 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceea3a-6c2a-492d-a8b6-32d1285a887d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:27.972055 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceea3a-6c2a-492d-a8b6-32d1285a887d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:27.972153 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceea3a-6c2a-492d-a8b6-32d1285a887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:27.990957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-50ceea3a-6c2a-492d-a8b6-32d1285a887d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:27.992255 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-50ceea3a-6c2a-492d-a8b6-32d1285a887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:28.050744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1247/2513] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:35:28.063997 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e6314-09d2-4d73-aee1-82973330fccf None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.064278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e6314-09d2-4d73-aee1-82973330fccf None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.064562 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e6314-09d2-4d73-aee1-82973330fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.082724 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-482e6314-09d2-4d73-aee1-82973330fccf None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:28.083920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-482e6314-09d2-4d73-aee1-82973330fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:28.092060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1267/2514] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:28.096161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceea3a-6c2a-492d-a8b6-32d1285a887d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.106291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceea3a-6c2a-492d-a8b6-32d1285a887d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.110852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f757f8e-1325-4002-b7d7-843673ac3c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.111519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f757f8e-1325-4002-b7d7-843673ac3c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.111805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f757f8e-1325-4002-b7d7-843673ac3c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.112079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f757f8e-1325-4002-b7d7-843673ac3c2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.112972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f757f8e-1325-4002-b7d7-843673ac3c2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:35:28.113090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f757f8e-1325-4002-b7d7-843673ac3c2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.114713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f757f8e-1325-4002-b7d7-843673ac3c2c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.126717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1248/2515] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:35:28.131452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e6314-09d2-4d73-aee1-82973330fccf None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.143550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e6314-09d2-4d73-aee1-82973330fccf None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.148763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239e443-673d-448f-8618-1332bdb88170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.149467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239e443-673d-448f-8618-1332bdb88170 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.149760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239e443-673d-448f-8618-1332bdb88170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.150066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239e443-673d-448f-8618-1332bdb88170 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.150883 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239e443-673d-448f-8618-1332bdb88170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.152809 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239e443-673d-448f-8618-1332bdb88170 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.182443 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1268/2516] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:35:28 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:35:28.186722 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f757f8e-1325-4002-b7d7-843673ac3c2c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.197013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f757f8e-1325-4002-b7d7-843673ac3c2c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.252902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355adf6-cc1c-4b9e-bb08-7cbfec8ff002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.253585 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355adf6-cc1c-4b9e-bb08-7cbfec8ff002 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.253869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355adf6-cc1c-4b9e-bb08-7cbfec8ff002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.254175 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355adf6-cc1c-4b9e-bb08-7cbfec8ff002 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.254869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355adf6-cc1c-4b9e-bb08-7cbfec8ff002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.256788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355adf6-cc1c-4b9e-bb08-7cbfec8ff002 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.285818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1249/2517] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:35:28 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:35:28.289831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239e443-673d-448f-8618-1332bdb88170 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.305779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355adf6-cc1c-4b9e-bb08-7cbfec8ff002 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.305779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5355adf6-cc1c-4b9e-bb08-7cbfec8ff002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:28.308112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239e443-673d-448f-8618-1332bdb88170 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.312579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149497f8-5681-4980-928b-012a13dde348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.313254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149497f8-5681-4980-928b-012a13dde348 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.313574 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149497f8-5681-4980-928b-012a13dde348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.313852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149497f8-5681-4980-928b-012a13dde348 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.314617 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149497f8-5681-4980-928b-012a13dde348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.316212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149497f8-5681-4980-928b-012a13dde348 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.328727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1269/2518] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:35:28.331261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149497f8-5681-4980-928b-012a13dde348 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.334204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-149497f8-5681-4980-928b-012a13dde348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:28.375962 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355adf6-cc1c-4b9e-bb08-7cbfec8ff002 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.381129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb445c-1189-4b56-b9e3-5c306546a71f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35ae873d42b490cae4dd610f2ac6a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.381776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb445c-1189-4b56-b9e3-5c306546a71f service placement] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.382060 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb445c-1189-4b56-b9e3-5c306546a71f service placement] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.382392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb445c-1189-4b56-b9e3-5c306546a71f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.384174 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-dffb445c-1189-4b56-b9e3-5c306546a71f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:28.389146 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149497f8-5681-4980-928b-012a13dde348 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.392761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a02d97-1404-48dc-8c57-3b57ddfa62a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.393404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02d97-1404-48dc-8c57-3b57ddfa62a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.393686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02d97-1404-48dc-8c57-3b57ddfa62a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.393965 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02d97-1404-48dc-8c57-3b57ddfa62a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.395587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb445c-1189-4b56-b9e3-5c306546a71f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.395753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-10a02d97-1404-48dc-8c57-3b57ddfa62a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:28.397563 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb445c-1189-4b56-b9e3-5c306546a71f service placement] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.407939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1250/2519] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:35:28.408853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb445c-1189-4b56-b9e3-5c306546a71f service placement] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.419911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb445c-1189-4b56-b9e3-5c306546a71f service placement] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.424491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a1f3c-3039-4f35-b02c-9b431bae0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.425132 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a1f3c-3039-4f35-b02c-9b431bae0f9c admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.425413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a1f3c-3039-4f35-b02c-9b431bae0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.425689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a1f3c-3039-4f35-b02c-9b431bae0f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.426436 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a1f3c-3039-4f35-b02c-9b431bae0f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.428019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a1f3c-3039-4f35-b02c-9b431bae0f9c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.440805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1251/2520] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:35:28.441895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a1f3c-3039-4f35-b02c-9b431bae0f9c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.451634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a1f3c-3039-4f35-b02c-9b431bae0f9c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.456760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51950eac-ea70-4e3a-9687-1ed2c8445de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.457796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51950eac-ea70-4e3a-9687-1ed2c8445de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.458281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51950eac-ea70-4e3a-9687-1ed2c8445de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.458718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51950eac-ea70-4e3a-9687-1ed2c8445de1 admin admin] PATH_INFO: `/v3/projects/e761b7a0e7034f5ca4fac4775ccc500d/users/02d830cb355440cd8ea53d4bf367fae9/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.468842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a02d97-1404-48dc-8c57-3b57ddfa62a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.470650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a02d97-1404-48dc-8c57-3b57ddfa62a0 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.474249 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51950eac-ea70-4e3a-9687-1ed2c8445de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e761b7a0e7034f5ca4fac4775ccc500d, user_id=02d830cb355440cd8ea53d4bf367fae9, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.477036 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51950eac-ea70-4e3a-9687-1ed2c8445de1 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.482685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1270/2521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:28.494560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1252/2522] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:35:28 2022] PUT /identity/v3/projects/e761b7a0e7034f5ca4fac4775ccc500d/users/02d830cb355440cd8ea53d4bf367fae9/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:28.504360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ce6d-9876-44b8-b579-77546441b679 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.505172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ce6d-9876-44b8-b579-77546441b679 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.505172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ce6d-9876-44b8-b579-77546441b679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.538030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fb88ce6d-9876-44b8-b579-77546441b679 None None] MFA Rules not processed for user `02d830cb355440cd8ea53d4bf367fae9`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:28.539258 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fb88ce6d-9876-44b8-b579-77546441b679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:28.606046 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1271/2523] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:28.610578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51950eac-ea70-4e3a-9687-1ed2c8445de1 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.673805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51950eac-ea70-4e3a-9687-1ed2c8445de1 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.678615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07aa46-79d0-48c0-a765-db66483aa94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.679274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07aa46-79d0-48c0-a765-db66483aa94c admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.679560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07aa46-79d0-48c0-a765-db66483aa94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.679837 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07aa46-79d0-48c0-a765-db66483aa94c admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.680538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07aa46-79d0-48c0-a765-db66483aa94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.682770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07aa46-79d0-48c0-a765-db66483aa94c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.709200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1253/2524] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:35:28 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:35:28.713347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ce6d-9876-44b8-b579-77546441b679 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.725194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ce6d-9876-44b8-b579-77546441b679 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.786023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78db93-8fd2-4049-984f-9cfe04b0add9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.786827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78db93-8fd2-4049-984f-9cfe04b0add9 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.787113 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78db93-8fd2-4049-984f-9cfe04b0add9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.787399 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78db93-8fd2-4049-984f-9cfe04b0add9 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.788087 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78db93-8fd2-4049-984f-9cfe04b0add9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.790072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78db93-8fd2-4049-984f-9cfe04b0add9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.810936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1272/2525] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:35:28 2022] POST /identity/v3/users => generated 307 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:35:28.815122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07aa46-79d0-48c0-a765-db66483aa94c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.825328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07aa46-79d0-48c0-a765-db66483aa94c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.830129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b21c-1ec9-4f48-9ac7-e424c2f51576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.831187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b21c-1ec9-4f48-9ac7-e424c2f51576 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.831583 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b21c-1ec9-4f48-9ac7-e424c2f51576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.831888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b21c-1ec9-4f48-9ac7-e424c2f51576 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.832760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b21c-1ec9-4f48-9ac7-e424c2f51576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.834785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b21c-1ec9-4f48-9ac7-e424c2f51576 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.846397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1254/2526] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:35:28.851021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78db93-8fd2-4049-984f-9cfe04b0add9 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.861799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78db93-8fd2-4049-984f-9cfe04b0add9 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.866676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187cc0-db18-4060-998c-d497983a9dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.867565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187cc0-db18-4060-998c-d497983a9dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.867847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187cc0-db18-4060-998c-d497983a9dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.868123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187cc0-db18-4060-998c-d497983a9dbc admin admin] PATH_INFO: `/v3/projects/920bf3b366c14e5b9e13d6b36763bc63/users/52b6b9d262a84ff9bdf086d3944a205e/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.883172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69187cc0-db18-4060-998c-d497983a9dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=920bf3b366c14e5b9e13d6b36763bc63, user_id=52b6b9d262a84ff9bdf086d3944a205e, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.885857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69187cc0-db18-4060-998c-d497983a9dbc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.899015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1273/2527] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:35:28 2022] PUT /identity/v3/projects/920bf3b366c14e5b9e13d6b36763bc63/users/52b6b9d262a84ff9bdf086d3944a205e/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:28.903422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b21c-1ec9-4f48-9ac7-e424c2f51576 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:28.913574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b21c-1ec9-4f48-9ac7-e424c2f51576 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:28.972726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4179ece-6276-47f4-8e9a-3c266e21a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:28.973535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4179ece-6276-47f4-8e9a-3c266e21a447 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:28.973857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4179ece-6276-47f4-8e9a-3c266e21a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:28.974143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4179ece-6276-47f4-8e9a-3c266e21a447 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:28.974923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4179ece-6276-47f4-8e9a-3c266e21a447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:28.976906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4179ece-6276-47f4-8e9a-3c266e21a447 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:28.988184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1255/2528] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:35:28.992005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187cc0-db18-4060-998c-d497983a9dbc admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:29.003221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187cc0-db18-4060-998c-d497983a9dbc admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:29.008851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe366a-a838-4c24-a9f8-7eb3298fc0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:29.009745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe366a-a838-4c24-a9f8-7eb3298fc0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:29.010028 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe366a-a838-4c24-a9f8-7eb3298fc0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:29.010334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe366a-a838-4c24-a9f8-7eb3298fc0b3 admin admin] PATH_INFO: `/v3/projects/920bf3b366c14e5b9e13d6b36763bc63/users/52b6b9d262a84ff9bdf086d3944a205e/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:29.012316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe366a-a838-4c24-a9f8-7eb3298fc0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920bf3b366c14e5b9e13d6b36763bc63, user_id=52b6b9d262a84ff9bdf086d3944a205e, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:29.015223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe366a-a838-4c24-a9f8-7eb3298fc0b3 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:29.026522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1274/2529] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:35:28 2022] PUT /identity/v3/projects/920bf3b366c14e5b9e13d6b36763bc63/users/52b6b9d262a84ff9bdf086d3944a205e/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:29.036496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcbf30-c6fc-46ba-833b-e2c99dfe473e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:29.036910 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcbf30-c6fc-46ba-833b-e2c99dfe473e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:29.037396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcbf30-c6fc-46ba-833b-e2c99dfe473e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:29.063202 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e7fcbf30-c6fc-46ba-833b-e2c99dfe473e None None] MFA Rules not processed for user `52b6b9d262a84ff9bdf086d3944a205e`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:29.064386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e7fcbf30-c6fc-46ba-833b-e2c99dfe473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:29.129375 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1256/2530] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:29.139866 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe366a-a838-4c24-a9f8-7eb3298fc0b3 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:29.141544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b4fe366a-a838-4c24-a9f8-7eb3298fc0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:29.195638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe366a-a838-4c24-a9f8-7eb3298fc0b3 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:29.199210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724d55-2ead-4783-8c19-f0d34a69539a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:29.199838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724d55-2ead-4783-8c19-f0d34a69539a service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:29.200118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724d55-2ead-4783-8c19-f0d34a69539a service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:29.200392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724d55-2ead-4783-8c19-f0d34a69539a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:29.208889 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10724d55-2ead-4783-8c19-f0d34a69539a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:29.210324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10724d55-2ead-4783-8c19-f0d34a69539a service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:29.220396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1275/2531] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:29.294177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcbf30-c6fc-46ba-833b-e2c99dfe473e None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:29.304081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcbf30-c6fc-46ba-833b-e2c99dfe473e None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:29.307757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1739a-f2cb-42cc-989a-332a7816c7bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:29.308460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1739a-f2cb-42cc-989a-332a7816c7bb service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:29.308741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1739a-f2cb-42cc-989a-332a7816c7bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:29.309015 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1739a-f2cb-42cc-989a-332a7816c7bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:29.367716 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1739a-f2cb-42cc-989a-332a7816c7bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:29.369155 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1739a-f2cb-42cc-989a-332a7816c7bb service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:29.378233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1257/2532] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:30.208299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724d55-2ead-4783-8c19-f0d34a69539a service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:30.209851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-10724d55-2ead-4783-8c19-f0d34a69539a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:30.266588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724d55-2ead-4783-8c19-f0d34a69539a service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:30.270277 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884f7a8-b620-43f2-9600-a13c03588a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:30.270969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884f7a8-b620-43f2-9600-a13c03588a43 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:30.271209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884f7a8-b620-43f2-9600-a13c03588a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:30.271485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884f7a8-b620-43f2-9600-a13c03588a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:30.273502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b884f7a8-b620-43f2-9600-a13c03588a43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:30.283648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884f7a8-b620-43f2-9600-a13c03588a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:30.285067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884f7a8-b620-43f2-9600-a13c03588a43 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:30.293039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1276/2533] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:34.484287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1739a-f2cb-42cc-989a-332a7816c7bb service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:34.543887 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1739a-f2cb-42cc-989a-332a7816c7bb service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:34.548553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:34.549414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:34.549694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:34.549964 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] PATH_INFO: `/v3/users/02d830cb355440cd8ea53d4bf367fae9` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:34.551205 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d830cb355440cd8ea53d4bf367fae9)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:34.553114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:34.597305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d830cb355440cd8ea53d4bf367fae9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:34.604391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d830cb355440cd8ea53d4bf367fae9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:34.604996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d830cb355440cd8ea53d4bf367fae9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:34.611673 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d830cb355440cd8ea53d4bf367fae9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:34.623514 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d830cb355440cd8ea53d4bf367fae9'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:34.629519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1258/2534] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:35:34 2022] DELETE /identity/v3/users/02d830cb355440cd8ea53d4bf367fae9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:34.634014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9649ce-b1e3-4d0e-b7c2-1781a9f56bd5 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:34.634494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9649ce-b1e3-4d0e-b7c2-1781a9f56bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:34.634606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9649ce-b1e3-4d0e-b7c2-1781a9f56bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:34.653072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-eb9649ce-b1e3-4d0e-b7c2-1781a9f56bd5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:34.654316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-eb9649ce-b1e3-4d0e-b7c2-1781a9f56bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:34.710483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1277/2535] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:34.720618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:34.722054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:34.775948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d681f71-a139-4e2a-bef9-b66259f68645 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:34.780889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc34f-31f9-4638-a6c6-6f6ea1d330e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:34.781525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc34f-31f9-4638-a6c6-6f6ea1d330e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:34.781812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc34f-31f9-4638-a6c6-6f6ea1d330e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:34.782088 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc34f-31f9-4638-a6c6-6f6ea1d330e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:34.790969 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc34f-31f9-4638-a6c6-6f6ea1d330e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:34.792422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc34f-31f9-4638-a6c6-6f6ea1d330e2 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:34.801507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1259/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:35:35.060569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9649ce-b1e3-4d0e-b7c2-1781a9f56bd5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:35.062574 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-eb9649ce-b1e3-4d0e-b7c2-1781a9f56bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:35.076763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9649ce-b1e3-4d0e-b7c2-1781a9f56bd5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:35.081932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:35.083525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:35.083994 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:35.084440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] PATH_INFO: `/v3/projects/e761b7a0e7034f5ca4fac4775ccc500d` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:35.086475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e761b7a0e7034f5ca4fac4775ccc500d)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:35.088745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:35.132810 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e761b7a0e7034f5ca4fac4775ccc500d', 'request_id': 'req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.140553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e761b7a0e7034f5ca4fac4775ccc500d', 'request_id': 'req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.146602 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e761b7a0e7034f5ca4fac4775ccc500d', 'request_id': 'req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.156571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] The token cache is being invalidate because project e761b7a0e7034f5ca4fac4775ccc500d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:35:35.156859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.157488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.159039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1278/2537] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:35:35 2022] DELETE /identity/v3/projects/e761b7a0e7034f5ca4fac4775ccc500d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:35.162978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc34f-31f9-4638-a6c6-6f6ea1d330e2 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:35.172537 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc34f-31f9-4638-a6c6-6f6ea1d330e2 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:35.226087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:35.226983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:35.227292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:35.227595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] PATH_INFO: `/v3/users/52b6b9d262a84ff9bdf086d3944a205e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:35.228793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b6b9d262a84ff9bdf086d3944a205e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:35.230786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:35.273499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b6b9d262a84ff9bdf086d3944a205e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.280427 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b6b9d262a84ff9bdf086d3944a205e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.281041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b6b9d262a84ff9bdf086d3944a205e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.287597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b6b9d262a84ff9bdf086d3944a205e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.299709 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d912d3b4-46f0-4d75-8299-53bc1dd514f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b6b9d262a84ff9bdf086d3944a205e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.305531 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1260/2538] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:35:35 2022] DELETE /identity/v3/users/52b6b9d262a84ff9bdf086d3944a205e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:35.564572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:35.566068 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:35.579096 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb487f74-3fd3-4cdb-b13d-16b53c982cc6 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:35.634514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:35.635389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:35.635679 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:35.636024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] PATH_INFO: `/v3/projects/920bf3b366c14e5b9e13d6b36763bc63` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:35.637169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920bf3b366c14e5b9e13d6b36763bc63)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:35.639110 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:35.683695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920bf3b366c14e5b9e13d6b36763bc63', 'request_id': 'req-79d96834-b6e3-4acf-8019-49cf2a1e42d8'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.692005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920bf3b366c14e5b9e13d6b36763bc63', 'request_id': 'req-79d96834-b6e3-4acf-8019-49cf2a1e42d8'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.697837 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920bf3b366c14e5b9e13d6b36763bc63', 'request_id': 'req-79d96834-b6e3-4acf-8019-49cf2a1e42d8'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.708340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] The token cache is being invalidate because project 920bf3b366c14e5b9e13d6b36763bc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:35:35.708650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.709285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-79d96834-b6e3-4acf-8019-49cf2a1e42d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:35.710867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1279/2539] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:35:35 2022] DELETE /identity/v3/projects/920bf3b366c14e5b9e13d6b36763bc63 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:35.716313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db5dfc-716a-4915-b479-7fff56a10f5d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:35.716781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db5dfc-716a-4915-b479-7fff56a10f5d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:35.716876 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db5dfc-716a-4915-b479-7fff56a10f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:35.735539 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-58db5dfc-716a-4915-b479-7fff56a10f5d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:35.736721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-58db5dfc-716a-4915-b479-7fff56a10f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:35.795399 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1261/2540] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:35.803137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097a37d-4156-473c-b7d1-299e6a071429 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:35.803457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097a37d-4156-473c-b7d1-299e6a071429 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:35.803760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097a37d-4156-473c-b7d1-299e6a071429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:35.821470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e097a37d-4156-473c-b7d1-299e6a071429 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:35.822718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e097a37d-4156-473c-b7d1-299e6a071429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:35.831105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1280/2541] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:35.834787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db5dfc-716a-4915-b479-7fff56a10f5d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:35.845331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db5dfc-716a-4915-b479-7fff56a10f5d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:35.849861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44e1d6-a177-4f51-9ab4-f10656a8f0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:35.850539 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44e1d6-a177-4f51-9ab4-f10656a8f0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:35.850818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44e1d6-a177-4f51-9ab4-f10656a8f0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:35.851091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44e1d6-a177-4f51-9ab4-f10656a8f0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:35.851846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44e1d6-a177-4f51-9ab4-f10656a8f0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:35:35.852133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44e1d6-a177-4f51-9ab4-f10656a8f0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:35.853746 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44e1d6-a177-4f51-9ab4-f10656a8f0d1 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:35.865459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1262/2542] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:35:35.869792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097a37d-4156-473c-b7d1-299e6a071429 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:35.878956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097a37d-4156-473c-b7d1-299e6a071429 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:35.883529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cf8c0-a802-4760-b1d3-183d4ac222df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:35.884229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cf8c0-a802-4760-b1d3-183d4ac222df admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:35.884512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cf8c0-a802-4760-b1d3-183d4ac222df admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:35.884789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cf8c0-a802-4760-b1d3-183d4ac222df admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:35.885511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cf8c0-a802-4760-b1d3-183d4ac222df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:35.887454 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cf8c0-a802-4760-b1d3-183d4ac222df admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:35.912752 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1281/2543] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:35:35 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:35:35.916882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44e1d6-a177-4f51-9ab4-f10656a8f0d1 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:35.927527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44e1d6-a177-4f51-9ab4-f10656a8f0d1 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:35.981204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac3f93-f126-4829-a6d8-ac8951788c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:35.981860 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac3f93-f126-4829-a6d8-ac8951788c34 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:35.982162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac3f93-f126-4829-a6d8-ac8951788c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:35.982437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac3f93-f126-4829-a6d8-ac8951788c34 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:35.983112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac3f93-f126-4829-a6d8-ac8951788c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:35.985004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac3f93-f126-4829-a6d8-ac8951788c34 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:36.007049 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1263/2544] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:35:35 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:35:36.008007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cf8c0-a802-4760-b1d3-183d4ac222df admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:36.018017 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cf8c0-a802-4760-b1d3-183d4ac222df admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:36.023088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcff2fe-25e8-4995-9916-b07f3f962dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:36.023896 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff2fe-25e8-4995-9916-b07f3f962dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:36.024179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff2fe-25e8-4995-9916-b07f3f962dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:36.024452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff2fe-25e8-4995-9916-b07f3f962dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:36.025266 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcff2fe-25e8-4995-9916-b07f3f962dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:36.027434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcff2fe-25e8-4995-9916-b07f3f962dcc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:36.037376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1282/2545] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:35:36.041243 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac3f93-f126-4829-a6d8-ac8951788c34 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:36.051491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac3f93-f126-4829-a6d8-ac8951788c34 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:36.056070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4870153-df1f-4a7e-99d4-545aee109e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:36.056712 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870153-df1f-4a7e-99d4-545aee109e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:36.056995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870153-df1f-4a7e-99d4-545aee109e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:36.057270 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870153-df1f-4a7e-99d4-545aee109e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:36.058008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4870153-df1f-4a7e-99d4-545aee109e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:36.059614 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4870153-df1f-4a7e-99d4-545aee109e6f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:36.069031 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1264/2546] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:35:36.072761 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcff2fe-25e8-4995-9916-b07f3f962dcc admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:36.082825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcff2fe-25e8-4995-9916-b07f3f962dcc admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:36.087347 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc4c68-b4a9-491c-88f1-7a5c61a7c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:36.088209 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc4c68-b4a9-491c-88f1-7a5c61a7c381 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:36.088485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc4c68-b4a9-491c-88f1-7a5c61a7c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:36.088756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc4c68-b4a9-491c-88f1-7a5c61a7c381 admin admin] PATH_INFO: `/v3/projects/8fe2469a86e7495eb8876574fdb68536/users/e46d8fd66b2a4a639e4a22e2abf29362/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:36.102489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc4c68-b4a9-491c-88f1-7a5c61a7c381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe2469a86e7495eb8876574fdb68536, user_id=e46d8fd66b2a4a639e4a22e2abf29362, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:36.105612 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc4c68-b4a9-491c-88f1-7a5c61a7c381 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:36.117907 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1283/2547] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:35:36 2022] PUT /identity/v3/projects/8fe2469a86e7495eb8876574fdb68536/users/e46d8fd66b2a4a639e4a22e2abf29362/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:36.129044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9c50-cb1e-44a7-b306-1560e7408dc0 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:36.129337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9c50-cb1e-44a7-b306-1560e7408dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:36.129627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9c50-cb1e-44a7-b306-1560e7408dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:36.155167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-589c9c50-cb1e-44a7-b306-1560e7408dc0 None None] MFA Rules not processed for user `e46d8fd66b2a4a639e4a22e2abf29362`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:36.156352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-589c9c50-cb1e-44a7-b306-1560e7408dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:36.217940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1265/2548] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:36.228863 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc4c68-b4a9-491c-88f1-7a5c61a7c381 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:36.231174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-edbc4c68-b4a9-491c-88f1-7a5c61a7c381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:36.285529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc4c68-b4a9-491c-88f1-7a5c61a7c381 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:36.289323 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7bb31-3dc8-40b3-bbab-77c34fc245ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:36.289975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7bb31-3dc8-40b3-bbab-77c34fc245ae service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:36.290297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7bb31-3dc8-40b3-bbab-77c34fc245ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:36.290580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7bb31-3dc8-40b3-bbab-77c34fc245ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:36.299652 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7bb31-3dc8-40b3-bbab-77c34fc245ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:36.301076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7bb31-3dc8-40b3-bbab-77c34fc245ae service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:36.310264 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1284/2549] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:36.328724 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9c50-cb1e-44a7-b306-1560e7408dc0 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:36.387286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9c50-cb1e-44a7-b306-1560e7408dc0 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:36.391821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:36.392672 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:36.392955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:36.393228 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] PATH_INFO: `/v3/users/e46d8fd66b2a4a639e4a22e2abf29362` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:36.394442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46d8fd66b2a4a639e4a22e2abf29362)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:36.396352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:36.441297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46d8fd66b2a4a639e4a22e2abf29362'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:36.448007 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46d8fd66b2a4a639e4a22e2abf29362'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:36.449184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46d8fd66b2a4a639e4a22e2abf29362'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:36.455734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46d8fd66b2a4a639e4a22e2abf29362'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:36.466735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46d8fd66b2a4a639e4a22e2abf29362'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:36.472549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1266/2550] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:35:36 2022] DELETE /identity/v3/users/e46d8fd66b2a4a639e4a22e2abf29362 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:36.477015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a2b00-c463-4fb7-9e30-c93f6b3d9c41 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:36.477314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a2b00-c463-4fb7-9e30-c93f6b3d9c41 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:36.477601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a2b00-c463-4fb7-9e30-c93f6b3d9c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:36.495026 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fa2a2b00-c463-4fb7-9e30-c93f6b3d9c41 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:36.496735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fa2a2b00-c463-4fb7-9e30-c93f6b3d9c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:36.552440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1285/2551] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:36.562354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:36.563751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:36.618244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72430-26bd-4523-9ef2-47ef8473d8f7 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:36.621862 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c0a95-b328-4fe3-9393-0cd7d141074a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:36.622525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0a95-b328-4fe3-9393-0cd7d141074a service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:36.622805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0a95-b328-4fe3-9393-0cd7d141074a service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:36.623079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0a95-b328-4fe3-9393-0cd7d141074a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:36.631769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c0a95-b328-4fe3-9393-0cd7d141074a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:36.633189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c0a95-b328-4fe3-9393-0cd7d141074a service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:36.642283 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1267/2552] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:36.898877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a2b00-c463-4fb7-9e30-c93f6b3d9c41 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:36.900356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fa2a2b00-c463-4fb7-9e30-c93f6b3d9c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:36.915587 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a2b00-c463-4fb7-9e30-c93f6b3d9c41 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:36.921172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:36.922046 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:36.922368 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:36.922655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] PATH_INFO: `/v3/projects/8fe2469a86e7495eb8876574fdb68536` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:36.927129 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe2469a86e7495eb8876574fdb68536)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:36.929770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:36.977319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe2469a86e7495eb8876574fdb68536', 'request_id': 'req-38c32f6f-0463-44b7-8611-c3abe942b0f7'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:36.984901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe2469a86e7495eb8876574fdb68536', 'request_id': 'req-38c32f6f-0463-44b7-8611-c3abe942b0f7'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:36.991225 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe2469a86e7495eb8876574fdb68536', 'request_id': 'req-38c32f6f-0463-44b7-8611-c3abe942b0f7'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:37.001442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] The token cache is being invalidate because project 8fe2469a86e7495eb8876574fdb68536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:35:37.001733 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:37.002400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-38c32f6f-0463-44b7-8611-c3abe942b0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:35:37.003940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1286/2553] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:35:36 2022] DELETE /identity/v3/projects/8fe2469a86e7495eb8876574fdb68536 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:37.008906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bbd3e-962b-4ebd-befe-ff0ba14f361c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.009372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bbd3e-962b-4ebd-befe-ff0ba14f361c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.009467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bbd3e-962b-4ebd-befe-ff0ba14f361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.028034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-456bbd3e-962b-4ebd-befe-ff0ba14f361c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:37.029293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-456bbd3e-962b-4ebd-befe-ff0ba14f361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:37.089001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1268/2554] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:35:37.097689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6cac-5878-487b-9e5b-1b2c5e5d0110 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.097985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6cac-5878-487b-9e5b-1b2c5e5d0110 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.098302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6cac-5878-487b-9e5b-1b2c5e5d0110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.116467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0e9c6cac-5878-487b-9e5b-1b2c5e5d0110 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:37.117660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0e9c6cac-5878-487b-9e5b-1b2c5e5d0110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:37.126063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1287/2555] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:37.129966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bbd3e-962b-4ebd-befe-ff0ba14f361c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:37.139547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bbd3e-962b-4ebd-befe-ff0ba14f361c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:37.145240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b062d5-4e8a-4b36-8640-a154710f1e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:37.145910 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b062d5-4e8a-4b36-8640-a154710f1e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.146219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b062d5-4e8a-4b36-8640-a154710f1e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.146494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b062d5-4e8a-4b36-8640-a154710f1e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.147481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b062d5-4e8a-4b36-8640-a154710f1e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:35:37.147783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b062d5-4e8a-4b36-8640-a154710f1e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:37.149701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b062d5-4e8a-4b36-8640-a154710f1e04 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:37.162534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1269/2556] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:35:37.166862 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6cac-5878-487b-9e5b-1b2c5e5d0110 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:37.176572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6cac-5878-487b-9e5b-1b2c5e5d0110 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:37.181267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751992-a11b-42d4-baea-435297cc4fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:37.181925 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751992-a11b-42d4-baea-435297cc4fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.182247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751992-a11b-42d4-baea-435297cc4fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.182580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751992-a11b-42d4-baea-435297cc4fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.183891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd751992-a11b-42d4-baea-435297cc4fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:37.185785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd751992-a11b-42d4-baea-435297cc4fe4 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:37.209923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1288/2557] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:35:37 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:35:37.213990 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b062d5-4e8a-4b36-8640-a154710f1e04 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:37.224225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b062d5-4e8a-4b36-8640-a154710f1e04 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:37.277144 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef3fe-a9c6-4ab6-b70a-1d3c313e3b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:37.277796 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef3fe-a9c6-4ab6-b70a-1d3c313e3b2b admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.278083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef3fe-a9c6-4ab6-b70a-1d3c313e3b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.278459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef3fe-a9c6-4ab6-b70a-1d3c313e3b2b admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.279139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebef3fe-a9c6-4ab6-b70a-1d3c313e3b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:37.281039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebef3fe-a9c6-4ab6-b70a-1d3c313e3b2b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:37.300967 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1270/2558] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:35:37 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:35:37.304972 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751992-a11b-42d4-baea-435297cc4fe4 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:37.315250 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751992-a11b-42d4-baea-435297cc4fe4 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:37.319865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039603-87a2-4e6f-b170-c59db809ecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:37.320521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039603-87a2-4e6f-b170-c59db809ecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.320806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039603-87a2-4e6f-b170-c59db809ecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.321084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039603-87a2-4e6f-b170-c59db809ecb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.321841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039603-87a2-4e6f-b170-c59db809ecb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:37.323472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039603-87a2-4e6f-b170-c59db809ecb9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:37.334200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1289/2559] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:35:37.337970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef3fe-a9c6-4ab6-b70a-1d3c313e3b2b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:37.348256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef3fe-a9c6-4ab6-b70a-1d3c313e3b2b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:37.352767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b50368-96bd-4aab-bd26-d770ce29c324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:37.353413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b50368-96bd-4aab-bd26-d770ce29c324 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.353697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b50368-96bd-4aab-bd26-d770ce29c324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.353975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b50368-96bd-4aab-bd26-d770ce29c324 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.355344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b50368-96bd-4aab-bd26-d770ce29c324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:37.356952 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b50368-96bd-4aab-bd26-d770ce29c324 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:37.366380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1271/2560] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:35:37.370246 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039603-87a2-4e6f-b170-c59db809ecb9 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:37.379814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039603-87a2-4e6f-b170-c59db809ecb9 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:37.384394 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9e2d3-33b3-468d-a9e2-79feaaaf0877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:37.385265 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e2d3-33b3-468d-a9e2-79feaaaf0877 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.385547 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e2d3-33b3-468d-a9e2-79feaaaf0877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.385823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e2d3-33b3-468d-a9e2-79feaaaf0877 admin admin] PATH_INFO: `/v3/projects/a666f13af65b4600b2be394c8cb38096/users/463ab34ce3f5477da4f55c25e40b0855/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.399902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9e2d3-33b3-468d-a9e2-79feaaaf0877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a666f13af65b4600b2be394c8cb38096, user_id=463ab34ce3f5477da4f55c25e40b0855, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:37.403066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9e2d3-33b3-468d-a9e2-79feaaaf0877 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:37.415460 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1290/2561] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:35:37 2022] PUT /identity/v3/projects/a666f13af65b4600b2be394c8cb38096/users/463ab34ce3f5477da4f55c25e40b0855/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:35:37.425521 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21152c9e-469f-446c-b0d2-46bee758f5d4 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.425845 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21152c9e-469f-446c-b0d2-46bee758f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.426193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21152c9e-469f-446c-b0d2-46bee758f5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.452611 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-21152c9e-469f-446c-b0d2-46bee758f5d4 None None] MFA Rules not processed for user `463ab34ce3f5477da4f55c25e40b0855`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:35:37.453848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-21152c9e-469f-446c-b0d2-46bee758f5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:37.516623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1272/2562] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:35:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:35:37.528613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9e2d3-33b3-468d-a9e2-79feaaaf0877 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:37.530327 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-33e9e2d3-33b3-468d-a9e2-79feaaaf0877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:37.585803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9e2d3-33b3-468d-a9e2-79feaaaf0877 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:37.590011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfd71-2274-44e0-949d-66b1c053e2dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9a11df2d3d4dc292a5115de69bb288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:37.590680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfd71-2274-44e0-949d-66b1c053e2dd service glance] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:37.590963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfd71-2274-44e0-949d-66b1c053e2dd service glance] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:37.591239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfd71-2274-44e0-949d-66b1c053e2dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:37.599318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddfd71-2274-44e0-949d-66b1c053e2dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:37.600672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddfd71-2274-44e0-949d-66b1c053e2dd service glance] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:37.609162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1291/2563] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:41.642679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21152c9e-469f-446c-b0d2-46bee758f5d4 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:41.645313 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-21152c9e-469f-446c-b0d2-46bee758f5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:41.737503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21152c9e-469f-446c-b0d2-46bee758f5d4 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:41.742822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32010f1-217e-4d12-aced-1b89d5ac3dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:41.743462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32010f1-217e-4d12-aced-1b89d5ac3dd1 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:41.743742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32010f1-217e-4d12-aced-1b89d5ac3dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:41.744017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32010f1-217e-4d12-aced-1b89d5ac3dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:41.745777 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e32010f1-217e-4d12-aced-1b89d5ac3dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:41.757333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32010f1-217e-4d12-aced-1b89d5ac3dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:41.758935 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32010f1-217e-4d12-aced-1b89d5ac3dd1 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:41.769610 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1273/2564] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:35:45.434953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfd71-2274-44e0-949d-66b1c053e2dd service glance] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:35:45.436335 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d4ddfd71-2274-44e0-949d-66b1c053e2dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:45.494825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfd71-2274-44e0-949d-66b1c053e2dd service glance] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:35:45.498882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e834c-4622-4a9f-b4cb-63987e4dc5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:35:45.499543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e834c-4622-4a9f-b4cb-63987e4dc5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:35:45.499792 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e834c-4622-4a9f-b4cb-63987e4dc5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:35:45.500089 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e834c-4622-4a9f-b4cb-63987e4dc5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:35:45.501842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c94e834c-4622-4a9f-b4cb-63987e4dc5d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:35:45.570021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e834c-4622-4a9f-b4cb-63987e4dc5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:35:45.572433 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e834c-4622-4a9f-b4cb-63987e4dc5d0 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:35:45.586996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1292/2565] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:35:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:04.608821 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32010f1-217e-4d12-aced-1b89d5ac3dd1 service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:04.669650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32010f1-217e-4d12-aced-1b89d5ac3dd1 service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:04.674497 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:04.675428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:04.675781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:04.676129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] PATH_INFO: `/v3/users/463ab34ce3f5477da4f55c25e40b0855` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:04.677310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=463ab34ce3f5477da4f55c25e40b0855)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:04.679411 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:04.721597 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463ab34ce3f5477da4f55c25e40b0855'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:04.727704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463ab34ce3f5477da4f55c25e40b0855'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:04.728318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463ab34ce3f5477da4f55c25e40b0855'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:04.735415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463ab34ce3f5477da4f55c25e40b0855'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:04.747328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463ab34ce3f5477da4f55c25e40b0855'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:04.753527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1274/2566] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:36:04 2022] DELETE /identity/v3/users/463ab34ce3f5477da4f55c25e40b0855 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:04.758385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa58efc-b076-4ab4-ae06-c51e62a75c1e None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:04.758888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa58efc-b076-4ab4-ae06-c51e62a75c1e None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:04.759001 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa58efc-b076-4ab4-ae06-c51e62a75c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:04.776126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-6fa58efc-b076-4ab4-ae06-c51e62a75c1e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:04.777319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6fa58efc-b076-4ab4-ae06-c51e62a75c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:04.837057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1293/2567] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:04.846890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:04.848311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:04.903003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c665462-facc-41ec-93d8-1c9824a4f426 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:04.906600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e0d5d-8174-4194-a98f-28515c177ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:04.907234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e0d5d-8174-4194-a98f-28515c177ceb service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:04.907518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e0d5d-8174-4194-a98f-28515c177ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:04.907816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e0d5d-8174-4194-a98f-28515c177ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:04.917621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e0d5d-8174-4194-a98f-28515c177ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:04.919068 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e0d5d-8174-4194-a98f-28515c177ceb service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:04.928263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1275/2568] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:05.182834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa58efc-b076-4ab4-ae06-c51e62a75c1e None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:05.184255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6fa58efc-b076-4ab4-ae06-c51e62a75c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:05.197021 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa58efc-b076-4ab4-ae06-c51e62a75c1e None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:05.202303 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:05.202725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.203005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.203280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] PATH_INFO: `/v3/projects/a666f13af65b4600b2be394c8cb38096` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.204454 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a666f13af65b4600b2be394c8cb38096)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:05.206543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:05.252221 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a666f13af65b4600b2be394c8cb38096', 'request_id': 'req-8926ed6f-a7a0-4018-9c54-2de413fd8765'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:05.259200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a666f13af65b4600b2be394c8cb38096', 'request_id': 'req-8926ed6f-a7a0-4018-9c54-2de413fd8765'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:05.265302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a666f13af65b4600b2be394c8cb38096', 'request_id': 'req-8926ed6f-a7a0-4018-9c54-2de413fd8765'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:05.275418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] The token cache is being invalidate because project a666f13af65b4600b2be394c8cb38096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:36:05.275708 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:05.276847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8926ed6f-a7a0-4018-9c54-2de413fd8765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:05.278413 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1294/2569] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:36:05 2022] DELETE /identity/v3/projects/a666f13af65b4600b2be394c8cb38096 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:05.283199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59cd15-35f8-4509-acb6-d99e2f0421eb None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.283494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59cd15-35f8-4509-acb6-d99e2f0421eb None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.283775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59cd15-35f8-4509-acb6-d99e2f0421eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.301985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-7f59cd15-35f8-4509-acb6-d99e2f0421eb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:05.303242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7f59cd15-35f8-4509-acb6-d99e2f0421eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:05.360800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1276/2570] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:36:05.368428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51506-c8fc-4b36-a4c8-3bdb3f15b382 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.368719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51506-c8fc-4b36-a4c8-3bdb3f15b382 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.368997 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51506-c8fc-4b36-a4c8-3bdb3f15b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.387048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-43f51506-c8fc-4b36-a4c8-3bdb3f15b382 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:05.388229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-43f51506-c8fc-4b36-a4c8-3bdb3f15b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:05.395911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1295/2571] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:05.400069 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59cd15-35f8-4509-acb6-d99e2f0421eb None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:05.410026 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59cd15-35f8-4509-acb6-d99e2f0421eb None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:05.414586 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad8d14-1a2b-4893-9a52-ceab2d614282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:05.415230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8d14-1a2b-4893-9a52-ceab2d614282 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.415512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8d14-1a2b-4893-9a52-ceab2d614282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.415784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8d14-1a2b-4893-9a52-ceab2d614282 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.416501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad8d14-1a2b-4893-9a52-ceab2d614282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:36:05.416805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad8d14-1a2b-4893-9a52-ceab2d614282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:05.418435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad8d14-1a2b-4893-9a52-ceab2d614282 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:05.429675 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1277/2572] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:36:05.433608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51506-c8fc-4b36-a4c8-3bdb3f15b382 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:05.442453 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51506-c8fc-4b36-a4c8-3bdb3f15b382 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:05.447025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f831a-fc5c-40ad-939f-8e9264763614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:05.447660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f831a-fc5c-40ad-939f-8e9264763614 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.448469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f831a-fc5c-40ad-939f-8e9264763614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.448749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f831a-fc5c-40ad-939f-8e9264763614 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.449420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f831a-fc5c-40ad-939f-8e9264763614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:05.451308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f831a-fc5c-40ad-939f-8e9264763614 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:05.475428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1296/2573] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:36:05 2022] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:36:05.479453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad8d14-1a2b-4893-9a52-ceab2d614282 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:05.489114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad8d14-1a2b-4893-9a52-ceab2d614282 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:05.543234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3e22-cc15-44ba-9a7d-843ced0a9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:05.543923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3e22-cc15-44ba-9a7d-843ced0a9a13 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.544214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3e22-cc15-44ba-9a7d-843ced0a9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.544534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3e22-cc15-44ba-9a7d-843ced0a9a13 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.545185 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3e22-cc15-44ba-9a7d-843ced0a9a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:05.547157 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3e22-cc15-44ba-9a7d-843ced0a9a13 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:05.571469 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1278/2574] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:36:05 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:36:05.572581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f831a-fc5c-40ad-939f-8e9264763614 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:05.582893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f831a-fc5c-40ad-939f-8e9264763614 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:05.587631 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80526f3-2008-4adb-9ad6-c7229b88f955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:05.588424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80526f3-2008-4adb-9ad6-c7229b88f955 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.588738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80526f3-2008-4adb-9ad6-c7229b88f955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.589012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80526f3-2008-4adb-9ad6-c7229b88f955 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.589763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80526f3-2008-4adb-9ad6-c7229b88f955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:05.591490 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80526f3-2008-4adb-9ad6-c7229b88f955 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:05.605430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1297/2575] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:36:05.608428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3e22-cc15-44ba-9a7d-843ced0a9a13 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:05.621647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3e22-cc15-44ba-9a7d-843ced0a9a13 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:05.631066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151c814-1600-4cb5-a0a9-df26aaa25453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:05.632291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151c814-1600-4cb5-a0a9-df26aaa25453 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.632731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151c814-1600-4cb5-a0a9-df26aaa25453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.633164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151c814-1600-4cb5-a0a9-df26aaa25453 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.634295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151c814-1600-4cb5-a0a9-df26aaa25453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:05.637892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151c814-1600-4cb5-a0a9-df26aaa25453 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:05.649689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1279/2576] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:36:05.654364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80526f3-2008-4adb-9ad6-c7229b88f955 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:05.664349 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80526f3-2008-4adb-9ad6-c7229b88f955 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:05.669755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a530fda-6600-413b-b33d-153571dc9e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:05.671194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a530fda-6600-413b-b33d-153571dc9e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.671194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a530fda-6600-413b-b33d-153571dc9e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.671435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a530fda-6600-413b-b33d-153571dc9e2e admin admin] PATH_INFO: `/v3/projects/5aa25f8ff5604e988a55f88f687d8efd/users/f8ea0158cf0f435ba3825f5dab7f5d24/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.686891 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a530fda-6600-413b-b33d-153571dc9e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa25f8ff5604e988a55f88f687d8efd, user_id=f8ea0158cf0f435ba3825f5dab7f5d24, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:05.689523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a530fda-6600-413b-b33d-153571dc9e2e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:05.703558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1298/2577] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:36:05 2022] PUT /identity/v3/projects/5aa25f8ff5604e988a55f88f687d8efd/users/f8ea0158cf0f435ba3825f5dab7f5d24/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:05.714909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b41d34-575c-420f-acbf-241da9f0b543 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.715276 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b41d34-575c-420f-acbf-241da9f0b543 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.715629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b41d34-575c-420f-acbf-241da9f0b543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.749668 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a5b41d34-575c-420f-acbf-241da9f0b543 None None] MFA Rules not processed for user `f8ea0158cf0f435ba3825f5dab7f5d24`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:05.750907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a5b41d34-575c-420f-acbf-241da9f0b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:05.812047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1280/2578] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:36:05.819019 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a530fda-6600-413b-b33d-153571dc9e2e admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:05.878020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a530fda-6600-413b-b33d-153571dc9e2e admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:05.882580 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a9035-ac18-4cb8-a45a-4caecea679b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:05.883220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9035-ac18-4cb8-a45a-4caecea679b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.883498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9035-ac18-4cb8-a45a-4caecea679b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.883773 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9035-ac18-4cb8-a45a-4caecea679b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.884442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a9035-ac18-4cb8-a45a-4caecea679b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:05.886395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a9035-ac18-4cb8-a45a-4caecea679b5 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:05.910337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1299/2579] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:36:05 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:36:05.914361 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b41d34-575c-420f-acbf-241da9f0b543 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:05.925568 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b41d34-575c-420f-acbf-241da9f0b543 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:05.978041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe58f-13f5-4162-9913-67a89236ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:05.978726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe58f-13f5-4162-9913-67a89236ae40 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:05.979009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe58f-13f5-4162-9913-67a89236ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:05.979866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe58f-13f5-4162-9913-67a89236ae40 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:05.980553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fe58f-13f5-4162-9913-67a89236ae40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:05.982474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fe58f-13f5-4162-9913-67a89236ae40 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.000975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1281/2580] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:36:05 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:36:06.004851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a9035-ac18-4cb8-a45a-4caecea679b5 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.014808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a9035-ac18-4cb8-a45a-4caecea679b5 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.019516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a8757-a373-4794-aff1-191c67515794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.020184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a8757-a373-4794-aff1-191c67515794 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.020470 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a8757-a373-4794-aff1-191c67515794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.020748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a8757-a373-4794-aff1-191c67515794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.021467 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a8757-a373-4794-aff1-191c67515794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.023356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a8757-a373-4794-aff1-191c67515794 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.034058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1300/2581] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:36:06.037699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe58f-13f5-4162-9913-67a89236ae40 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.047954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe58f-13f5-4162-9913-67a89236ae40 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.052619 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542dfe6-0586-41d1-89ce-8578efa45e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.053266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542dfe6-0586-41d1-89ce-8578efa45e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.053548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542dfe6-0586-41d1-89ce-8578efa45e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.053826 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542dfe6-0586-41d1-89ce-8578efa45e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.054576 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542dfe6-0586-41d1-89ce-8578efa45e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.056164 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542dfe6-0586-41d1-89ce-8578efa45e40 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.065793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1282/2582] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:36:06.069672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a8757-a373-4794-aff1-191c67515794 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.080060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a8757-a373-4794-aff1-191c67515794 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.084628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde8573-00f2-40b2-bb52-355cbb1a7b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.085487 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde8573-00f2-40b2-bb52-355cbb1a7b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.085769 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde8573-00f2-40b2-bb52-355cbb1a7b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.086045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde8573-00f2-40b2-bb52-355cbb1a7b7b admin admin] PATH_INFO: `/v3/projects/546f4d5a0d09455a86c28ad192ad6843/users/64f11bd5eda141f0965bdb96b5c65b2b/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.101853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde8573-00f2-40b2-bb52-355cbb1a7b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=546f4d5a0d09455a86c28ad192ad6843, user_id=64f11bd5eda141f0965bdb96b5c65b2b, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.104655 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde8573-00f2-40b2-bb52-355cbb1a7b7b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.117249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1301/2583] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:36:06 2022] PUT /identity/v3/projects/546f4d5a0d09455a86c28ad192ad6843/users/64f11bd5eda141f0965bdb96b5c65b2b/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:36:06.128448 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4aaab-c77e-4721-9331-1115a69bea58 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.128697 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4aaab-c77e-4721-9331-1115a69bea58 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.128977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4aaab-c77e-4721-9331-1115a69bea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.156782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-17c4aaab-c77e-4721-9331-1115a69bea58 None None] MFA Rules not processed for user `64f11bd5eda141f0965bdb96b5c65b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:06.157986 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-17c4aaab-c77e-4721-9331-1115a69bea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:06.220713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1283/2584] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:36:06.225471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde8573-00f2-40b2-bb52-355cbb1a7b7b admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.290245 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde8573-00f2-40b2-bb52-355cbb1a7b7b admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.294963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca8322-829d-49b2-ad84-96298b1ca448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.295626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca8322-829d-49b2-ad84-96298b1ca448 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.295912 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca8322-829d-49b2-ad84-96298b1ca448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.296190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca8322-829d-49b2-ad84-96298b1ca448 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.296872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca8322-829d-49b2-ad84-96298b1ca448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.298799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca8322-829d-49b2-ad84-96298b1ca448 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.323971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1302/2585] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:36:06 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:36:06.328129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4aaab-c77e-4721-9331-1115a69bea58 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.339219 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4aaab-c77e-4721-9331-1115a69bea58 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.391515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6bc46-5ea1-4599-929c-97f59fde66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.392093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6bc46-5ea1-4599-929c-97f59fde66c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.392371 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6bc46-5ea1-4599-929c-97f59fde66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.392640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6bc46-5ea1-4599-929c-97f59fde66c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.393303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6bc46-5ea1-4599-929c-97f59fde66c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.395250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6bc46-5ea1-4599-929c-97f59fde66c2 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.417812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1284/2586] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:36:06 2022] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:36:06.419075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca8322-829d-49b2-ad84-96298b1ca448 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.429309 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca8322-829d-49b2-ad84-96298b1ca448 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.434356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8422de-a779-4962-be5d-f002b42a0123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.435004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8422de-a779-4962-be5d-f002b42a0123 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.435314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8422de-a779-4962-be5d-f002b42a0123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.435590 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8422de-a779-4962-be5d-f002b42a0123 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.436304 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8422de-a779-4962-be5d-f002b42a0123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.437872 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8422de-a779-4962-be5d-f002b42a0123 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.447356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1303/2587] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:36:06.452056 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6bc46-5ea1-4599-929c-97f59fde66c2 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.461968 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6bc46-5ea1-4599-929c-97f59fde66c2 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.466493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4bce1-5a57-46ae-9a85-798fe7bd4035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.467363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4bce1-5a57-46ae-9a85-798fe7bd4035 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.467640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4bce1-5a57-46ae-9a85-798fe7bd4035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.467917 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4bce1-5a57-46ae-9a85-798fe7bd4035 admin admin] PATH_INFO: `/v3/projects/6f75b1dcd8774a4492c9b19241b1a7fd/users/0c6889e441bf41a9a30143d618bbb5e0/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.482129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4bce1-5a57-46ae-9a85-798fe7bd4035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f75b1dcd8774a4492c9b19241b1a7fd, user_id=0c6889e441bf41a9a30143d618bbb5e0, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.485041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4bce1-5a57-46ae-9a85-798fe7bd4035 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.497694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1285/2588] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:36:06 2022] PUT /identity/v3/projects/6f75b1dcd8774a4492c9b19241b1a7fd/users/0c6889e441bf41a9a30143d618bbb5e0/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:36:06.501723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8422de-a779-4962-be5d-f002b42a0123 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.512243 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8422de-a779-4962-be5d-f002b42a0123 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.566415 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7981130-b4e1-49ab-af50-b6e08ef6abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.567111 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7981130-b4e1-49ab-af50-b6e08ef6abb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.567451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7981130-b4e1-49ab-af50-b6e08ef6abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.567758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7981130-b4e1-49ab-af50-b6e08ef6abb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.568576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7981130-b4e1-49ab-af50-b6e08ef6abb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.570199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7981130-b4e1-49ab-af50-b6e08ef6abb9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.580400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1304/2589] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:36:06.584494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4bce1-5a57-46ae-9a85-798fe7bd4035 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.594752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4bce1-5a57-46ae-9a85-798fe7bd4035 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.599377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d6411-c474-4264-bb04-e00cb4ddc77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.600303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d6411-c474-4264-bb04-e00cb4ddc77f admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.600587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d6411-c474-4264-bb04-e00cb4ddc77f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.600868 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d6411-c474-4264-bb04-e00cb4ddc77f admin admin] PATH_INFO: `/v3/projects/6f75b1dcd8774a4492c9b19241b1a7fd/users/0c6889e441bf41a9a30143d618bbb5e0/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.602845 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d6411-c474-4264-bb04-e00cb4ddc77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f75b1dcd8774a4492c9b19241b1a7fd, user_id=0c6889e441bf41a9a30143d618bbb5e0, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.605487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d6411-c474-4264-bb04-e00cb4ddc77f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.615528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1286/2590] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:36:06 2022] PUT /identity/v3/projects/6f75b1dcd8774a4492c9b19241b1a7fd/users/0c6889e441bf41a9a30143d618bbb5e0/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:06.626284 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d533-4f9f-40af-b30f-3cb9fcf8d55a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.626579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d533-4f9f-40af-b30f-3cb9fcf8d55a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.626859 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d533-4f9f-40af-b30f-3cb9fcf8d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.653516 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-2d46d533-4f9f-40af-b30f-3cb9fcf8d55a None None] MFA Rules not processed for user `0c6889e441bf41a9a30143d618bbb5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:06.654747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2d46d533-4f9f-40af-b30f-3cb9fcf8d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:06.722939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1305/2591] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:06.736123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d6411-c474-4264-bb04-e00cb4ddc77f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.739289 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-833d6411-c474-4264-bb04-e00cb4ddc77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:06.746002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d533-4f9f-40af-b30f-3cb9fcf8d55a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:06.747429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2d46d533-4f9f-40af-b30f-3cb9fcf8d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:06.801458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d6411-c474-4264-bb04-e00cb4ddc77f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.805279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c399d-3454-4ebf-8ae3-e510794468d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.805700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d533-4f9f-40af-b30f-3cb9fcf8d55a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:06.805919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c399d-3454-4ebf-8ae3-e510794468d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.806244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c399d-3454-4ebf-8ae3-e510794468d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.806526 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c399d-3454-4ebf-8ae3-e510794468d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.810226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a70ab0-719b-42fa-ad12-45b76128d424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:06.811057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a70ab0-719b-42fa-ad12-45b76128d424 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:06.811514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a70ab0-719b-42fa-ad12-45b76128d424 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:06.811955 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a70ab0-719b-42fa-ad12-45b76128d424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:06.814094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b7a70ab0-719b-42fa-ad12-45b76128d424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:06.863352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c399d-3454-4ebf-8ae3-e510794468d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.865328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c399d-3454-4ebf-8ae3-e510794468d3 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.874822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1287/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:06.899946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a70ab0-719b-42fa-ad12-45b76128d424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:06.902012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a70ab0-719b-42fa-ad12-45b76128d424 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:06.921592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1306/2593] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:36:08.293155 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c399d-3454-4ebf-8ae3-e510794468d3 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:08.298908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-5e8c399d-3454-4ebf-8ae3-e510794468d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:08.363069 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c399d-3454-4ebf-8ae3-e510794468d3 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:08.366828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad46b5-fd1e-4628-9f0c-b75960da89ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:08.367473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad46b5-fd1e-4628-9f0c-b75960da89ec service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:08.367757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad46b5-fd1e-4628-9f0c-b75960da89ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:08.368033 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad46b5-fd1e-4628-9f0c-b75960da89ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:08.370731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-74ad46b5-fd1e-4628-9f0c-b75960da89ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:08.431895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad46b5-fd1e-4628-9f0c-b75960da89ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:08.433779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad46b5-fd1e-4628-9f0c-b75960da89ec service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:08.443268 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1288/2594] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:09.489823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a70ab0-719b-42fa-ad12-45b76128d424 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:09.499522 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a70ab0-719b-42fa-ad12-45b76128d424 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:09.503660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727804d6-6809-4082-9768-14ba79af2e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:09.504464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727804d6-6809-4082-9768-14ba79af2e5a service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:09.504847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727804d6-6809-4082-9768-14ba79af2e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:09.505218 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727804d6-6809-4082-9768-14ba79af2e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:09.564918 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727804d6-6809-4082-9768-14ba79af2e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:09.566446 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727804d6-6809-4082-9768-14ba79af2e5a service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:09.575264 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1307/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:10.105518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad46b5-fd1e-4628-9f0c-b75960da89ec service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:10.115088 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad46b5-fd1e-4628-9f0c-b75960da89ec service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:10.118789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f720-9140-44a6-bfb0-7e86873b8e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:10.119688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f720-9140-44a6-bfb0-7e86873b8e96 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:10.120070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f720-9140-44a6-bfb0-7e86873b8e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:10.120414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f720-9140-44a6-bfb0-7e86873b8e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:10.130495 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465f720-9140-44a6-bfb0-7e86873b8e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:10.132020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465f720-9140-44a6-bfb0-7e86873b8e96 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:10.143471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1289/2596] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:10.951156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727804d6-6809-4082-9768-14ba79af2e5a service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:10.960397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727804d6-6809-4082-9768-14ba79af2e5a service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:10.969286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e513e-3e5b-4524-ac1e-e568c8330747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:10.969976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e513e-3e5b-4524-ac1e-e568c8330747 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:10.970371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e513e-3e5b-4524-ac1e-e568c8330747 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:10.970848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e513e-3e5b-4524-ac1e-e568c8330747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:10.973161 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-699e513e-3e5b-4524-ac1e-e568c8330747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:11.036951 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e513e-3e5b-4524-ac1e-e568c8330747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:11.038533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e513e-3e5b-4524-ac1e-e568c8330747 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:11.048565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1308/2597] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:12.268236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f720-9140-44a6-bfb0-7e86873b8e96 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:12.269682 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8465f720-9140-44a6-bfb0-7e86873b8e96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:12.286155 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f720-9140-44a6-bfb0-7e86873b8e96 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:12.291153 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:12.292549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:12.292828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:12.293324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] PATH_INFO: `/v3/users/719425608bc4447ea2f433e12ebbb180` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:12.294560 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=719425608bc4447ea2f433e12ebbb180)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:12.296470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:12.347923 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719425608bc4447ea2f433e12ebbb180'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.356938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719425608bc4447ea2f433e12ebbb180'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.357674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719425608bc4447ea2f433e12ebbb180'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.364444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719425608bc4447ea2f433e12ebbb180'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.376763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4e0ce545-9e3a-4390-aa7b-f8da103f54cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719425608bc4447ea2f433e12ebbb180'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.384382 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1290/2598] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:36:12 2022] DELETE /identity/v3/users/719425608bc4447ea2f433e12ebbb180 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:12.561257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e513e-3e5b-4524-ac1e-e568c8330747 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:12.573878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e513e-3e5b-4524-ac1e-e568c8330747 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:12.642754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:12.643621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:12.643905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:12.644189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] PATH_INFO: `/v3/projects/8bfade72cd754d9092d313481b3f465f` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:12.645368 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfade72cd754d9092d313481b3f465f)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:12.647555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:12.691855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfade72cd754d9092d313481b3f465f', 'request_id': 'req-43354738-cb3f-4e95-86e0-d7ff9b1586e9'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.699148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfade72cd754d9092d313481b3f465f', 'request_id': 'req-43354738-cb3f-4e95-86e0-d7ff9b1586e9'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.707325 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfade72cd754d9092d313481b3f465f', 'request_id': 'req-43354738-cb3f-4e95-86e0-d7ff9b1586e9'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.727533 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] The token cache is being invalidate because project 8bfade72cd754d9092d313481b3f465f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:36:12.727902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.728722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:12.732141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1309/2599] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:36:12 2022] DELETE /identity/v3/projects/8bfade72cd754d9092d313481b3f465f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:12.737113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836681a-0834-484b-a121-c8b413da87ab None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:12.737525 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836681a-0834-484b-a121-c8b413da87ab None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:12.738040 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836681a-0834-484b-a121-c8b413da87ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:12.762372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:12.768840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:12.776349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3836681a-0834-484b-a121-c8b413da87ab None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:12.777859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3836681a-0834-484b-a121-c8b413da87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:12.899073 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1291/2600] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:12.906820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43354738-cb3f-4e95-86e0-d7ff9b1586e9 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:12.911311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cef84-82af-4105-a93c-4b6e5a0de1db None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:12.911645 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cef84-82af-4105-a93c-4b6e5a0de1db None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:12.911931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cef84-82af-4105-a93c-4b6e5a0de1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:12.926440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94962427-b215-4c79-aa37-6502b98138f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:12.927353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94962427-b215-4c79-aa37-6502b98138f9 service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:12.927860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94962427-b215-4c79-aa37-6502b98138f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:12.928343 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94962427-b215-4c79-aa37-6502b98138f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:12.933108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-94962427-b215-4c79-aa37-6502b98138f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:12.935326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a81cef84-82af-4105-a93c-4b6e5a0de1db None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:12.936509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a81cef84-82af-4105-a93c-4b6e5a0de1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:12.946960 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1292/2601] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:12.952342 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cef84-82af-4105-a93c-4b6e5a0de1db None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:12.961007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94962427-b215-4c79-aa37-6502b98138f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:12.962888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94962427-b215-4c79-aa37-6502b98138f9 service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:12.965892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cef84-82af-4105-a93c-4b6e5a0de1db None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:12.972811 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128a9d3-b262-421a-bf80-98a2c24a4a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:12.973904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128a9d3-b262-421a-bf80-98a2c24a4a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:12.975352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128a9d3-b262-421a-bf80-98a2c24a4a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:12.975827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128a9d3-b262-421a-bf80-98a2c24a4a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:12.976638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128a9d3-b262-421a-bf80-98a2c24a4a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:36:12.976947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128a9d3-b262-421a-bf80-98a2c24a4a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:12.978866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128a9d3-b262-421a-bf80-98a2c24a4a02 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:12.984519 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1310/2602] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:12.998244 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1293/2603] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:36:12.999053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94962427-b215-4c79-aa37-6502b98138f9 service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:13.011119 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94962427-b215-4c79-aa37-6502b98138f9 service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:13.016241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad12b0-43ba-4711-b86a-08baa4d1d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:13.017299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad12b0-43ba-4711-b86a-08baa4d1d478 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:13.017754 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad12b0-43ba-4711-b86a-08baa4d1d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:13.018297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad12b0-43ba-4711-b86a-08baa4d1d478 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:13.019137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad12b0-43ba-4711-b86a-08baa4d1d478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:13.023468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad12b0-43ba-4711-b86a-08baa4d1d478 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:13.073368 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1311/2604] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:36:12 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:36:13.077429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128a9d3-b262-421a-bf80-98a2c24a4a02 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:13.088334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128a9d3-b262-421a-bf80-98a2c24a4a02 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:13.185501 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd2f84-7e58-4784-9769-4ec6b22b7470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:13.187671 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd2f84-7e58-4784-9769-4ec6b22b7470 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:13.192255 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd2f84-7e58-4784-9769-4ec6b22b7470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:13.192909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd2f84-7e58-4784-9769-4ec6b22b7470 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:13.196653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd2f84-7e58-4784-9769-4ec6b22b7470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:13.199653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd2f84-7e58-4784-9769-4ec6b22b7470 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:13.226266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1294/2605] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:36:13 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:36:13.228704 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad12b0-43ba-4711-b86a-08baa4d1d478 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:13.240849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad12b0-43ba-4711-b86a-08baa4d1d478 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:13.255577 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9b827-06b1-44f4-bcb1-52ab0486f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:13.256268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b827-06b1-44f4-bcb1-52ab0486f6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:13.256575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b827-06b1-44f4-bcb1-52ab0486f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:13.256943 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b827-06b1-44f4-bcb1-52ab0486f6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:13.257548 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9b827-06b1-44f4-bcb1-52ab0486f6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:13.259160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9b827-06b1-44f4-bcb1-52ab0486f6d4 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:13.282779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1312/2606] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:36:13.283019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd2f84-7e58-4784-9769-4ec6b22b7470 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:13.313763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd2f84-7e58-4784-9769-4ec6b22b7470 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:13.327140 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5c6af-8b5a-42bd-b426-b8f9bdc704d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:13.327817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5c6af-8b5a-42bd-b426-b8f9bdc704d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:13.328103 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5c6af-8b5a-42bd-b426-b8f9bdc704d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:13.328380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5c6af-8b5a-42bd-b426-b8f9bdc704d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:13.329109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5c6af-8b5a-42bd-b426-b8f9bdc704d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:13.330763 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5c6af-8b5a-42bd-b426-b8f9bdc704d4 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:13.344265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1295/2607] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:36:13.348425 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9b827-06b1-44f4-bcb1-52ab0486f6d4 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:13.360787 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9b827-06b1-44f4-bcb1-52ab0486f6d4 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:13.367887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa3573-d7a6-4b3e-bea2-5aca6a17b6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:13.371488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa3573-d7a6-4b3e-bea2-5aca6a17b6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:13.372148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa3573-d7a6-4b3e-bea2-5aca6a17b6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:13.372806 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa3573-d7a6-4b3e-bea2-5aca6a17b6ef admin admin] PATH_INFO: `/v3/projects/eb84d6d59c2e46ba8b899a7ccd56cd69/users/9a122667e0d94221bcf4b4819a674072/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:13.399853 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa3573-d7a6-4b3e-bea2-5aca6a17b6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb84d6d59c2e46ba8b899a7ccd56cd69, user_id=9a122667e0d94221bcf4b4819a674072, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:13.403354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa3573-d7a6-4b3e-bea2-5aca6a17b6ef admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:13.428506 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1313/2608] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:36:13 2022] PUT /identity/v3/projects/eb84d6d59c2e46ba8b899a7ccd56cd69/users/9a122667e0d94221bcf4b4819a674072/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:36:13.440126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd5ca-021f-4855-ab5a-3f420dea2c64 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:13.440422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd5ca-021f-4855-ab5a-3f420dea2c64 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:13.440756 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd5ca-021f-4855-ab5a-3f420dea2c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:13.478274 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ea2fd5ca-021f-4855-ab5a-3f420dea2c64 None None] MFA Rules not processed for user `9a122667e0d94221bcf4b4819a674072`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:13.480273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ea2fd5ca-021f-4855-ab5a-3f420dea2c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:13.574039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1296/2609] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:13.587823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa3573-d7a6-4b3e-bea2-5aca6a17b6ef admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:13.590247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0caa3573-d7a6-4b3e-bea2-5aca6a17b6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:13.653198 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa3573-d7a6-4b3e-bea2-5aca6a17b6ef admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:13.656817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96222ca-98a6-43a9-8fcf-2a7046ab50f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:13.657466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96222ca-98a6-43a9-8fcf-2a7046ab50f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:13.657748 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96222ca-98a6-43a9-8fcf-2a7046ab50f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:13.658019 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96222ca-98a6-43a9-8fcf-2a7046ab50f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:13.667015 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96222ca-98a6-43a9-8fcf-2a7046ab50f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:13.668918 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96222ca-98a6-43a9-8fcf-2a7046ab50f8 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:13.679703 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1314/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:36:14.331168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd5ca-021f-4855-ab5a-3f420dea2c64 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:14.332577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ea2fd5ca-021f-4855-ab5a-3f420dea2c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:14.397042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd5ca-021f-4855-ab5a-3f420dea2c64 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:14.402317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:14.403171 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:14.403451 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:14.403725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] PATH_INFO: `/v3/users/f8ea0158cf0f435ba3825f5dab7f5d24` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:14.404893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ea0158cf0f435ba3825f5dab7f5d24)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:14.406859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:14.450254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ea0158cf0f435ba3825f5dab7f5d24'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:14.456161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ea0158cf0f435ba3825f5dab7f5d24'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:14.456758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ea0158cf0f435ba3825f5dab7f5d24'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:14.463295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ea0158cf0f435ba3825f5dab7f5d24'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:14.476805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ea0158cf0f435ba3825f5dab7f5d24'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:14.483720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1297/2611] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:36:14 2022] DELETE /identity/v3/users/f8ea0158cf0f435ba3825f5dab7f5d24 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:14.488141 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82f1ee-16eb-4231-a272-1b5d8fc44fd6 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:14.488434 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82f1ee-16eb-4231-a272-1b5d8fc44fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:14.488727 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82f1ee-16eb-4231-a272-1b5d8fc44fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:14.506524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fd82f1ee-16eb-4231-a272-1b5d8fc44fd6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:14.507779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fd82f1ee-16eb-4231-a272-1b5d8fc44fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:14.566078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1315/2612] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:36:14.576728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:14.578184 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:14.636772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6df8-742d-46b4-808b-7dbe4a2f8c8b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:14.640795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d06fc8-1694-4b47-bd0e-03767c2705c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:14.641475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d06fc8-1694-4b47-bd0e-03767c2705c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:14.641759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d06fc8-1694-4b47-bd0e-03767c2705c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:14.642035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d06fc8-1694-4b47-bd0e-03767c2705c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:14.651838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d06fc8-1694-4b47-bd0e-03767c2705c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:14.653273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d06fc8-1694-4b47-bd0e-03767c2705c9 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:14.663779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1298/2613] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:14.916969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82f1ee-16eb-4231-a272-1b5d8fc44fd6 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:14.918689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fd82f1ee-16eb-4231-a272-1b5d8fc44fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:14.932870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82f1ee-16eb-4231-a272-1b5d8fc44fd6 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:14.938256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:14.939232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:14.939613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:14.939982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] PATH_INFO: `/v3/projects/5aa25f8ff5604e988a55f88f687d8efd` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:14.942864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa25f8ff5604e988a55f88f687d8efd)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:14.945360 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:14.991232 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa25f8ff5604e988a55f88f687d8efd', 'request_id': 'req-4d84635f-459d-4282-9251-8f6eb51112b8'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:14.999330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa25f8ff5604e988a55f88f687d8efd', 'request_id': 'req-4d84635f-459d-4282-9251-8f6eb51112b8'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.005988 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa25f8ff5604e988a55f88f687d8efd', 'request_id': 'req-4d84635f-459d-4282-9251-8f6eb51112b8'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.016921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] The token cache is being invalidate because project 5aa25f8ff5604e988a55f88f687d8efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:36:15.017321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.017964 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.019494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1316/2614] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:36:14 2022] DELETE /identity/v3/projects/5aa25f8ff5604e988a55f88f687d8efd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:15.023663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d06fc8-1694-4b47-bd0e-03767c2705c9 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:15.033171 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d06fc8-1694-4b47-bd0e-03767c2705c9 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:15.089029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:15.089904 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:15.090223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:15.090507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] PATH_INFO: `/v3/users/64f11bd5eda141f0965bdb96b5c65b2b` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:15.091728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f11bd5eda141f0965bdb96b5c65b2b)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:15.093631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:15.139844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f11bd5eda141f0965bdb96b5c65b2b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.146902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f11bd5eda141f0965bdb96b5c65b2b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.147948 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f11bd5eda141f0965bdb96b5c65b2b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.155267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f11bd5eda141f0965bdb96b5c65b2b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.166833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f11bd5eda141f0965bdb96b5c65b2b'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.172848 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1299/2615] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:36:15 2022] DELETE /identity/v3/users/64f11bd5eda141f0965bdb96b5c65b2b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:36:15.605046 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:15.606607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:15.619334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84635f-459d-4282-9251-8f6eb51112b8 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:15.684583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:15.685540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:15.685836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:15.686099 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] PATH_INFO: `/v3/projects/546f4d5a0d09455a86c28ad192ad6843` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:15.687340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546f4d5a0d09455a86c28ad192ad6843)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:15.689265 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:15.741776 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546f4d5a0d09455a86c28ad192ad6843', 'request_id': 'req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.751029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546f4d5a0d09455a86c28ad192ad6843', 'request_id': 'req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.759899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546f4d5a0d09455a86c28ad192ad6843', 'request_id': 'req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.771458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] The token cache is being invalidate because project 546f4d5a0d09455a86c28ad192ad6843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:36:15.771749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.772731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.774566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1317/2616] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:36:15 2022] DELETE /identity/v3/projects/546f4d5a0d09455a86c28ad192ad6843 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:15.779395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:15.780846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:15.821081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4fabc-87c8-4005-a88c-c9cdbd6e25fc admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:15.894745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:15.895615 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:15.895891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:15.896167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] PATH_INFO: `/v3/users/0c6889e441bf41a9a30143d618bbb5e0` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:15.897599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6889e441bf41a9a30143d618bbb5e0)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:15.899543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:15.945596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6889e441bf41a9a30143d618bbb5e0'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.954415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6889e441bf41a9a30143d618bbb5e0'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.955126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6889e441bf41a9a30143d618bbb5e0'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.962500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6889e441bf41a9a30143d618bbb5e0'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.974810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-69f63be8-0beb-40f8-985a-c37c2460f255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6889e441bf41a9a30143d618bbb5e0'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:15.980607 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1300/2617] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:36:15 2022] DELETE /identity/v3/users/0c6889e441bf41a9a30143d618bbb5e0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:36:16.263002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:16.265760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:16.283645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7dcd7-fc4a-476c-ba88-a0b3c963a6d2 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:16.341494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:16.342571 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.342851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.343135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] PATH_INFO: `/v3/projects/6f75b1dcd8774a4492c9b19241b1a7fd` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.344317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f75b1dcd8774a4492c9b19241b1a7fd)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:16.346245 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:16.393534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f75b1dcd8774a4492c9b19241b1a7fd', 'request_id': 'req-62b52a88-5729-45db-a94e-f3c3e826bb0a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:16.410351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f75b1dcd8774a4492c9b19241b1a7fd', 'request_id': 'req-62b52a88-5729-45db-a94e-f3c3e826bb0a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:16.417729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f75b1dcd8774a4492c9b19241b1a7fd', 'request_id': 'req-62b52a88-5729-45db-a94e-f3c3e826bb0a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:16.429663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] The token cache is being invalidate because project 6f75b1dcd8774a4492c9b19241b1a7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:36:16.429953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:16.430660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-62b52a88-5729-45db-a94e-f3c3e826bb0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:16.432903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1318/2618] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:36:16 2022] DELETE /identity/v3/projects/6f75b1dcd8774a4492c9b19241b1a7fd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:16.438065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00e1d-bc00-4d61-b81f-7dfd67c4548f None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.438407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00e1d-bc00-4d61-b81f-7dfd67c4548f None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.438691 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00e1d-bc00-4d61-b81f-7dfd67c4548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.461413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-bed00e1d-bc00-4d61-b81f-7dfd67c4548f None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:16.462737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-bed00e1d-bc00-4d61-b81f-7dfd67c4548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:16.527162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1301/2619] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:16.535936 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4736d0-1bfa-45e5-9ce7-2ec57b5bc5b5 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.536497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4736d0-1bfa-45e5-9ce7-2ec57b5bc5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.537053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4736d0-1bfa-45e5-9ce7-2ec57b5bc5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.580328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-fc4736d0-1bfa-45e5-9ce7-2ec57b5bc5b5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:16.581826 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fc4736d0-1bfa-45e5-9ce7-2ec57b5bc5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:16.596972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed00e1d-bc00-4d61-b81f-7dfd67c4548f None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:16.598813 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1319/2620] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:16.609402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed00e1d-bc00-4d61-b81f-7dfd67c4548f None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:16.615512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0545ea-fd83-474e-8281-3c125355fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:16.616273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0545ea-fd83-474e-8281-3c125355fd72 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.616618 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0545ea-fd83-474e-8281-3c125355fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.616978 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0545ea-fd83-474e-8281-3c125355fd72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.618562 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0545ea-fd83-474e-8281-3c125355fd72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:36:16.618946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0545ea-fd83-474e-8281-3c125355fd72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:16.621200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0545ea-fd83-474e-8281-3c125355fd72 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:16.634757 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1302/2621] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:36:16.639456 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4736d0-1bfa-45e5-9ce7-2ec57b5bc5b5 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:16.649190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4736d0-1bfa-45e5-9ce7-2ec57b5bc5b5 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:16.654065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9929bff-5c4f-4e12-bccb-aab7c670dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:16.654756 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929bff-5c4f-4e12-bccb-aab7c670dd3f admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.655050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929bff-5c4f-4e12-bccb-aab7c670dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.655328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929bff-5c4f-4e12-bccb-aab7c670dd3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.656025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9929bff-5c4f-4e12-bccb-aab7c670dd3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:16.657932 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9929bff-5c4f-4e12-bccb-aab7c670dd3f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:16.706078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1320/2622] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:36:16 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:36:16.706381 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0545ea-fd83-474e-8281-3c125355fd72 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:16.711189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0545ea-fd83-474e-8281-3c125355fd72 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:16.776681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18199430-dfbd-4062-93d2-10f7716b364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:16.777523 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18199430-dfbd-4062-93d2-10f7716b364a admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.777812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18199430-dfbd-4062-93d2-10f7716b364a admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.778091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18199430-dfbd-4062-93d2-10f7716b364a admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.778872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18199430-dfbd-4062-93d2-10f7716b364a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:16.780829 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18199430-dfbd-4062-93d2-10f7716b364a admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:16.804139 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1303/2623] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:36:16 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:36:16.805376 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9929bff-5c4f-4e12-bccb-aab7c670dd3f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:16.816097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9929bff-5c4f-4e12-bccb-aab7c670dd3f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:16.820845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623c3ac-e839-49e1-8aa8-d4fa2a251b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:16.821501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623c3ac-e839-49e1-8aa8-d4fa2a251b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.821779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623c3ac-e839-49e1-8aa8-d4fa2a251b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.822051 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623c3ac-e839-49e1-8aa8-d4fa2a251b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.822860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623c3ac-e839-49e1-8aa8-d4fa2a251b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:16.824429 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623c3ac-e839-49e1-8aa8-d4fa2a251b1e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:16.834453 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1321/2624] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:36:16.838539 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18199430-dfbd-4062-93d2-10f7716b364a admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:16.848446 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18199430-dfbd-4062-93d2-10f7716b364a admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:16.852973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bb162-a244-4d85-be68-82b6ff0943a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:16.853619 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bb162-a244-4d85-be68-82b6ff0943a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.853914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bb162-a244-4d85-be68-82b6ff0943a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.854752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bb162-a244-4d85-be68-82b6ff0943a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.855472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bb162-a244-4d85-be68-82b6ff0943a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:16.857052 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bb162-a244-4d85-be68-82b6ff0943a8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:16.866528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1304/2625] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:36:16.871181 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623c3ac-e839-49e1-8aa8-d4fa2a251b1e admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:16.882676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623c3ac-e839-49e1-8aa8-d4fa2a251b1e admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:16.887575 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1e92-8465-432e-9364-c99bda3eb9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:16.889058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1e92-8465-432e-9364-c99bda3eb9de admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.889504 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1e92-8465-432e-9364-c99bda3eb9de admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.890037 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1e92-8465-432e-9364-c99bda3eb9de admin admin] PATH_INFO: `/v3/projects/7faedd79b7b74eb189b7b44480c22f3d/users/04168be3f8f54f10acaf9a282549deec/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.908902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d1e92-8465-432e-9364-c99bda3eb9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7faedd79b7b74eb189b7b44480c22f3d, user_id=04168be3f8f54f10acaf9a282549deec, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:16.911645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d1e92-8465-432e-9364-c99bda3eb9de admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:16.931762 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1322/2626] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:36:16 2022] PUT /identity/v3/projects/7faedd79b7b74eb189b7b44480c22f3d/users/04168be3f8f54f10acaf9a282549deec/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:16.935874 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ad435-32ce-481f-bcf7-68f44e8fc7b2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:16.936174 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ad435-32ce-481f-bcf7-68f44e8fc7b2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:16.936456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ad435-32ce-481f-bcf7-68f44e8fc7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:16.964312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-770ad435-32ce-481f-bcf7-68f44e8fc7b2 None None] MFA Rules not processed for user `04168be3f8f54f10acaf9a282549deec`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:16.965520 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-770ad435-32ce-481f-bcf7-68f44e8fc7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:17.032101 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1305/2627] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:17.044035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1e92-8465-432e-9364-c99bda3eb9de admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:17.045902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b35d1e92-8465-432e-9364-c99bda3eb9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:17.102366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1e92-8465-432e-9364-c99bda3eb9de admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:17.105959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb51a06-104b-4033-bcf3-bf040d8c4262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:17.106650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb51a06-104b-4033-bcf3-bf040d8c4262 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:17.106939 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb51a06-104b-4033-bcf3-bf040d8c4262 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:17.107688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb51a06-104b-4033-bcf3-bf040d8c4262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:17.116518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb51a06-104b-4033-bcf3-bf040d8c4262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:17.117982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb51a06-104b-4033-bcf3-bf040d8c4262 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:17.127501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1323/2628] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:17.958768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ad435-32ce-481f-bcf7-68f44e8fc7b2 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:17.960426 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-770ad435-32ce-481f-bcf7-68f44e8fc7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:18.018020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ad435-32ce-481f-bcf7-68f44e8fc7b2 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:18.021616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592a354-a275-484e-be34-004de9acd308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:18.022555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592a354-a275-484e-be34-004de9acd308 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:18.022843 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592a354-a275-484e-be34-004de9acd308 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:18.023122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592a354-a275-484e-be34-004de9acd308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:18.024914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0592a354-a275-484e-be34-004de9acd308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:18.091386 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592a354-a275-484e-be34-004de9acd308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:18.093253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592a354-a275-484e-be34-004de9acd308 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:18.103798 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1306/2629] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:22.115729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb51a06-104b-4033-bcf3-bf040d8c4262 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:22.117186 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-3bb51a06-104b-4033-bcf3-bf040d8c4262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:22.132781 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb51a06-104b-4033-bcf3-bf040d8c4262 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:22.137890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:22.139234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:22.139709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:22.140148 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] PATH_INFO: `/v3/users/9a122667e0d94221bcf4b4819a674072` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:22.141586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a122667e0d94221bcf4b4819a674072)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:22.143753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:22.194942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a122667e0d94221bcf4b4819a674072'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.202488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a122667e0d94221bcf4b4819a674072'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.210425 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a122667e0d94221bcf4b4819a674072'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.211180 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a122667e0d94221bcf4b4819a674072'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.211875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a122667e0d94221bcf4b4819a674072'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.233282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1324/2630] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:36:22 2022] DELETE /identity/v3/users/9a122667e0d94221bcf4b4819a674072 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:22.235287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590547b-6a3d-46f9-9993-096ee405041b None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:22.235770 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590547b-6a3d-46f9-9993-096ee405041b None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:22.236079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590547b-6a3d-46f9-9993-096ee405041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:22.255023 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-c590547b-6a3d-46f9-9993-096ee405041b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:22.256407 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c590547b-6a3d-46f9-9993-096ee405041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:22.316406 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1307/2631] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:36:22.326864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:22.328308 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:22.390663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397841a-8143-401e-bb22-d4d6c33c0881 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:22.394577 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432b877-5854-4887-b632-0450f32ea5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:22.395324 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432b877-5854-4887-b632-0450f32ea5fc service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:22.395713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432b877-5854-4887-b632-0450f32ea5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:22.396084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432b877-5854-4887-b632-0450f32ea5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:22.406635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432b877-5854-4887-b632-0450f32ea5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:22.408380 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432b877-5854-4887-b632-0450f32ea5fc service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:22.420105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1325/2632] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:22.833842 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590547b-6a3d-46f9-9993-096ee405041b None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:22.835555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-c590547b-6a3d-46f9-9993-096ee405041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:22.849569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590547b-6a3d-46f9-9993-096ee405041b None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:22.868815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:22.869909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:22.870298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:22.870659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] PATH_INFO: `/v3/projects/eb84d6d59c2e46ba8b899a7ccd56cd69` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:22.872067 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb84d6d59c2e46ba8b899a7ccd56cd69)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:22.874041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:22.925472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb84d6d59c2e46ba8b899a7ccd56cd69', 'request_id': 'req-9ffbf571-0139-4ea0-bf89-bc24356ec001'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.931499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb84d6d59c2e46ba8b899a7ccd56cd69', 'request_id': 'req-9ffbf571-0139-4ea0-bf89-bc24356ec001'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.939225 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb84d6d59c2e46ba8b899a7ccd56cd69', 'request_id': 'req-9ffbf571-0139-4ea0-bf89-bc24356ec001'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.950819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] The token cache is being invalidate because project eb84d6d59c2e46ba8b899a7ccd56cd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:36:22.953256 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.954214 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9ffbf571-0139-4ea0-bf89-bc24356ec001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:22.956624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1308/2633] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:36:22 2022] DELETE /identity/v3/projects/eb84d6d59c2e46ba8b899a7ccd56cd69 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:22.961322 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7e4c6-3937-4b5e-8afb-3ea9f7b2ec19 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:22.961615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7e4c6-3937-4b5e-8afb-3ea9f7b2ec19 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:22.961898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7e4c6-3937-4b5e-8afb-3ea9f7b2ec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:22.988952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-44b7e4c6-3937-4b5e-8afb-3ea9f7b2ec19 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:22.990279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-44b7e4c6-3937-4b5e-8afb-3ea9f7b2ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:23.052192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1326/2634] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:36:23.061418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89860820-e2eb-4daa-8e8d-ca03839739ca None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.062267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89860820-e2eb-4daa-8e8d-ca03839739ca None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.062624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89860820-e2eb-4daa-8e8d-ca03839739ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.100861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-89860820-e2eb-4daa-8e8d-ca03839739ca None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:23.103046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-89860820-e2eb-4daa-8e8d-ca03839739ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:23.114698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1309/2635] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:36:23.125510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7e4c6-3937-4b5e-8afb-3ea9f7b2ec19 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.139615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7e4c6-3937-4b5e-8afb-3ea9f7b2ec19 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.144684 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683961e6-decb-4c06-af19-c60abb21331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.145351 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683961e6-decb-4c06-af19-c60abb21331d admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.145642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683961e6-decb-4c06-af19-c60abb21331d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.145919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683961e6-decb-4c06-af19-c60abb21331d admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.146692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683961e6-decb-4c06-af19-c60abb21331d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:36:23.147024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683961e6-decb-4c06-af19-c60abb21331d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:23.149053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683961e6-decb-4c06-af19-c60abb21331d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:23.165958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1327/2636] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:36:23.166937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89860820-e2eb-4daa-8e8d-ca03839739ca None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.177409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89860820-e2eb-4daa-8e8d-ca03839739ca None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.186177 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238acc9-35fa-4365-9914-f823841c7093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.187008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238acc9-35fa-4365-9914-f823841c7093 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.187479 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238acc9-35fa-4365-9914-f823841c7093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.187906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238acc9-35fa-4365-9914-f823841c7093 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.188879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238acc9-35fa-4365-9914-f823841c7093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:23.191187 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238acc9-35fa-4365-9914-f823841c7093 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:23.228193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1310/2637] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:36:23 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:36:23.229438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683961e6-decb-4c06-af19-c60abb21331d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.240515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683961e6-decb-4c06-af19-c60abb21331d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.324174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657594d-2952-4ce3-9088-f9c57f908ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.324843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657594d-2952-4ce3-9088-f9c57f908ece admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.325122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657594d-2952-4ce3-9088-f9c57f908ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.325444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657594d-2952-4ce3-9088-f9c57f908ece admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.326182 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657594d-2952-4ce3-9088-f9c57f908ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:23.328666 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657594d-2952-4ce3-9088-f9c57f908ece admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:23.353132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1328/2638] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:36:23 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:36:23.357824 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238acc9-35fa-4365-9914-f823841c7093 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.368117 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238acc9-35fa-4365-9914-f823841c7093 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.373355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7d38-9320-4b47-8e73-8d8dfb9b9a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.374016 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7d38-9320-4b47-8e73-8d8dfb9b9a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.374352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7d38-9320-4b47-8e73-8d8dfb9b9a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.374629 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7d38-9320-4b47-8e73-8d8dfb9b9a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.375349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d7d38-9320-4b47-8e73-8d8dfb9b9a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:23.377109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d7d38-9320-4b47-8e73-8d8dfb9b9a80 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:23.387413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1311/2639] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:36:23.391420 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657594d-2952-4ce3-9088-f9c57f908ece admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.401852 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657594d-2952-4ce3-9088-f9c57f908ece admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.406677 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c837917-7c6b-4b23-8791-6f60ff61bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.407430 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c837917-7c6b-4b23-8791-6f60ff61bcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.407720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c837917-7c6b-4b23-8791-6f60ff61bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.408002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c837917-7c6b-4b23-8791-6f60ff61bcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.408722 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c837917-7c6b-4b23-8791-6f60ff61bcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:23.410338 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c837917-7c6b-4b23-8791-6f60ff61bcc6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:23.420913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1329/2640] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:36:23.425261 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7d38-9320-4b47-8e73-8d8dfb9b9a80 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.435613 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7d38-9320-4b47-8e73-8d8dfb9b9a80 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.440207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e6ca7-46dc-49f0-b6a0-5f50e48a16d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.441079 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6ca7-46dc-49f0-b6a0-5f50e48a16d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.441362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6ca7-46dc-49f0-b6a0-5f50e48a16d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.441641 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6ca7-46dc-49f0-b6a0-5f50e48a16d3 admin admin] PATH_INFO: `/v3/projects/af27e25d20994622b197710f967cc15c/users/b7a1e081efb0495f96aa44a116fb43bb/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.457055 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e6ca7-46dc-49f0-b6a0-5f50e48a16d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af27e25d20994622b197710f967cc15c, user_id=b7a1e081efb0495f96aa44a116fb43bb, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:23.460001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e6ca7-46dc-49f0-b6a0-5f50e48a16d3 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:23.473273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1312/2641] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:36:23 2022] PUT /identity/v3/projects/af27e25d20994622b197710f967cc15c/users/b7a1e081efb0495f96aa44a116fb43bb/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:23.486032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a053b56-3864-4c90-9014-6db9cb4b2126 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.486353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a053b56-3864-4c90-9014-6db9cb4b2126 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.486637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a053b56-3864-4c90-9014-6db9cb4b2126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.516228 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0a053b56-3864-4c90-9014-6db9cb4b2126 None None] MFA Rules not processed for user `b7a1e081efb0495f96aa44a116fb43bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:23.517525 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0a053b56-3864-4c90-9014-6db9cb4b2126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:23.588130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1330/2642] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:23.592593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e6ca7-46dc-49f0-b6a0-5f50e48a16d3 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.658025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e6ca7-46dc-49f0-b6a0-5f50e48a16d3 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.666204 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03881323-4999-40b6-9d42-bc4e0fda0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.667880 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03881323-4999-40b6-9d42-bc4e0fda0414 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.668273 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03881323-4999-40b6-9d42-bc4e0fda0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.668658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03881323-4999-40b6-9d42-bc4e0fda0414 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.669633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03881323-4999-40b6-9d42-bc4e0fda0414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:23.672279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03881323-4999-40b6-9d42-bc4e0fda0414 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:23.721578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a053b56-3864-4c90-9014-6db9cb4b2126 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.723151 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1313/2643] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:36:23 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:36:23.733556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a053b56-3864-4c90-9014-6db9cb4b2126 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.824987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97ce4-b176-43ea-9333-2380c8081291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.826598 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97ce4-b176-43ea-9333-2380c8081291 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.827137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97ce4-b176-43ea-9333-2380c8081291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.827624 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97ce4-b176-43ea-9333-2380c8081291 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.828692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97ce4-b176-43ea-9333-2380c8081291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:23.831082 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97ce4-b176-43ea-9333-2380c8081291 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:23.868938 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1331/2644] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:36:23 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:36:23.873202 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03881323-4999-40b6-9d42-bc4e0fda0414 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.894250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03881323-4999-40b6-9d42-bc4e0fda0414 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.904091 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053259a-6e09-49c3-876c-0c4015099673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.905163 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053259a-6e09-49c3-876c-0c4015099673 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.905625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053259a-6e09-49c3-876c-0c4015099673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.906229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053259a-6e09-49c3-876c-0c4015099673 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:23.907410 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053259a-6e09-49c3-876c-0c4015099673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:23.911287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053259a-6e09-49c3-876c-0c4015099673 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:23.941796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97ce4-b176-43ea-9333-2380c8081291 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:23.943419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1314/2645] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:36:23.955698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97ce4-b176-43ea-9333-2380c8081291 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:23.969959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9608b2-84bf-48b7-8902-e040afea4b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:23.974621 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9608b2-84bf-48b7-8902-e040afea4b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:23.974931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9608b2-84bf-48b7-8902-e040afea4b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:23.975219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9608b2-84bf-48b7-8902-e040afea4b33 admin admin] PATH_INFO: `/v3/projects/45964d34c4be44dcaed15dceee6b0213/users/ab37ab8e9ea04c6ab20634d91120f53f/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:24.028681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9608b2-84bf-48b7-8902-e040afea4b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45964d34c4be44dcaed15dceee6b0213, user_id=ab37ab8e9ea04c6ab20634d91120f53f, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:24.031919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9608b2-84bf-48b7-8902-e040afea4b33 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:24.065203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1332/2646] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:36:23 2022] PUT /identity/v3/projects/45964d34c4be44dcaed15dceee6b0213/users/ab37ab8e9ea04c6ab20634d91120f53f/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:36:24.070346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053259a-6e09-49c3-876c-0c4015099673 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:24.085725 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053259a-6e09-49c3-876c-0c4015099673 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:24.159118 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1e268-3f02-45cf-bd40-9e244a5958ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:24.159801 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1e268-3f02-45cf-bd40-9e244a5958ab admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:24.160088 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1e268-3f02-45cf-bd40-9e244a5958ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:24.160367 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1e268-3f02-45cf-bd40-9e244a5958ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:24.161094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1e268-3f02-45cf-bd40-9e244a5958ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:24.162747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1e268-3f02-45cf-bd40-9e244a5958ab admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:24.175828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1315/2647] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:36:24.180083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9608b2-84bf-48b7-8902-e040afea4b33 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:24.192013 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9608b2-84bf-48b7-8902-e040afea4b33 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:24.201432 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4cae0-4fc5-4cce-854e-bae1e3e49303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:24.203448 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4cae0-4fc5-4cce-854e-bae1e3e49303 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:24.204006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4cae0-4fc5-4cce-854e-bae1e3e49303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:24.204841 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4cae0-4fc5-4cce-854e-bae1e3e49303 admin admin] PATH_INFO: `/v3/projects/45964d34c4be44dcaed15dceee6b0213/users/ab37ab8e9ea04c6ab20634d91120f53f/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:24.207780 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4cae0-4fc5-4cce-854e-bae1e3e49303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45964d34c4be44dcaed15dceee6b0213, user_id=ab37ab8e9ea04c6ab20634d91120f53f, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:24.210718 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4cae0-4fc5-4cce-854e-bae1e3e49303 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:24.223588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1333/2648] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:36:24 2022] PUT /identity/v3/projects/45964d34c4be44dcaed15dceee6b0213/users/ab37ab8e9ea04c6ab20634d91120f53f/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:36:24.234272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8001c-8a45-48cc-aefc-b6f7e0d7d043 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:24.234564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8001c-8a45-48cc-aefc-b6f7e0d7d043 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:24.234869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8001c-8a45-48cc-aefc-b6f7e0d7d043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:24.264165 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-20e8001c-8a45-48cc-aefc-b6f7e0d7d043 None None] MFA Rules not processed for user `ab37ab8e9ea04c6ab20634d91120f53f`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:24.265460 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-20e8001c-8a45-48cc-aefc-b6f7e0d7d043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:24.339067 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1316/2649] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:36:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:24.350963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4cae0-4fc5-4cce-854e-bae1e3e49303 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:24.352681 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9ba4cae0-4fc5-4cce-854e-bae1e3e49303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:24.423316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4cae0-4fc5-4cce-854e-bae1e3e49303 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:24.428983 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8e66a-70ec-4601-977f-3be0762e15f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:24.429993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e66a-70ec-4601-977f-3be0762e15f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:24.430529 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e66a-70ec-4601-977f-3be0762e15f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:24.431009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e66a-70ec-4601-977f-3be0762e15f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:24.442447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8e66a-70ec-4601-977f-3be0762e15f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:24.444238 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8e66a-70ec-4601-977f-3be0762e15f0 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:24.457059 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1334/2650] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:24.568736 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8001c-8a45-48cc-aefc-b6f7e0d7d043 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:24.581787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8001c-8a45-48cc-aefc-b6f7e0d7d043 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:24.585603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e6a64-b24a-4680-9e60-2902299647e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:24.586290 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e6a64-b24a-4680-9e60-2902299647e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:24.586577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e6a64-b24a-4680-9e60-2902299647e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:24.586852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e6a64-b24a-4680-9e60-2902299647e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:24.640966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e6a64-b24a-4680-9e60-2902299647e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:24.642350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e6a64-b24a-4680-9e60-2902299647e8 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:24.651911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1317/2651] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:25.592435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8e66a-70ec-4601-977f-3be0762e15f0 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:25.594493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-dcc8e66a-70ec-4601-977f-3be0762e15f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:25.661334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8e66a-70ec-4601-977f-3be0762e15f0 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:25.665921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:25.667364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:25.667645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:25.668061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] PATH_INFO: `/v3/users/b7eb6740ee4547fdaa5df3ba69640adf` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:25.669238 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7eb6740ee4547fdaa5df3ba69640adf)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:25.671174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:25.718370 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7eb6740ee4547fdaa5df3ba69640adf'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:25.724845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7eb6740ee4547fdaa5df3ba69640adf'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:25.732364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7eb6740ee4547fdaa5df3ba69640adf'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:25.733223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7eb6740ee4547fdaa5df3ba69640adf'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:25.734063 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7eb6740ee4547fdaa5df3ba69640adf'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:25.751344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1335/2652] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:36:25 2022] DELETE /identity/v3/users/b7eb6740ee4547fdaa5df3ba69640adf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:36:25.918392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e6a64-b24a-4680-9e60-2902299647e8 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:25.930301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e6a64-b24a-4680-9e60-2902299647e8 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:25.989201 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:25.990086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:25.990374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:25.990650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] PATH_INFO: `/v3/projects/55e43dcbd9b149b4abf235a40dd4a211` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:25.991827 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e43dcbd9b149b4abf235a40dd4a211)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:25.993877 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:26.040286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e43dcbd9b149b4abf235a40dd4a211', 'request_id': 'req-75e3b67d-694a-42f7-ac81-e3150bd067ee'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.046480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e43dcbd9b149b4abf235a40dd4a211', 'request_id': 'req-75e3b67d-694a-42f7-ac81-e3150bd067ee'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.053940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e43dcbd9b149b4abf235a40dd4a211', 'request_id': 'req-75e3b67d-694a-42f7-ac81-e3150bd067ee'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.071536 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] The token cache is being invalidate because project 55e43dcbd9b149b4abf235a40dd4a211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:36:26.071833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.072651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.077747 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1318/2653] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:36:25 2022] DELETE /identity/v3/projects/55e43dcbd9b149b4abf235a40dd4a211 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:26.079274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:26.080750 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:26.097849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f98cb5-788e-4d22-94a1-5b1f3c067d2f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:26.163743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:26.164728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:26.165006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:26.165276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] PATH_INFO: `/v3/users/cf5c251d6ada4447a967b2e87f2c20f4` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:26.166534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf5c251d6ada4447a967b2e87f2c20f4)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:26.168419 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:26.212759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf5c251d6ada4447a967b2e87f2c20f4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.219301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf5c251d6ada4447a967b2e87f2c20f4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.226080 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf5c251d6ada4447a967b2e87f2c20f4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.226736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf5c251d6ada4447a967b2e87f2c20f4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.227359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c3d16035-d7e2-4802-985f-f58f94d532dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf5c251d6ada4447a967b2e87f2c20f4'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.244007 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1336/2654] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:36:26 2022] DELETE /identity/v3/users/cf5c251d6ada4447a967b2e87f2c20f4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:36:26.411217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:26.412712 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:26.429591 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b67d-694a-42f7-ac81-e3150bd067ee admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:26.485745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:26.486638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:26.486917 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:26.487325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] PATH_INFO: `/v3/projects/fd40a4cee66c4e2ba3a1c942da77340b` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:26.488497 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd40a4cee66c4e2ba3a1c942da77340b)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:26.490452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:26.533596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd40a4cee66c4e2ba3a1c942da77340b', 'request_id': 'req-7fff7785-b337-41a0-87ec-c276b971718f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.539439 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd40a4cee66c4e2ba3a1c942da77340b', 'request_id': 'req-7fff7785-b337-41a0-87ec-c276b971718f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.546414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd40a4cee66c4e2ba3a1c942da77340b', 'request_id': 'req-7fff7785-b337-41a0-87ec-c276b971718f'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.556392 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] The token cache is being invalidate because project fd40a4cee66c4e2ba3a1c942da77340b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:36:26.556679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.557934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:36:26.559475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1319/2655] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:36:26 2022] DELETE /identity/v3/projects/fd40a4cee66c4e2ba3a1c942da77340b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:36:28.974798 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614d319-305e-44be-b9cf-cfe472dd2810 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:28.975461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614d319-305e-44be-b9cf-cfe472dd2810 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:28.975743 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614d319-305e-44be-b9cf-cfe472dd2810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:28.995270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-5614d319-305e-44be-b9cf-cfe472dd2810 None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:28.996483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-5614d319-305e-44be-b9cf-cfe472dd2810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:29.051790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1337/2656] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:36:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:29.099701 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:29.101093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:29.180543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff7785-b337-41a0-87ec-c276b971718f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:29.186465 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90596a93-bb0f-4fbf-a8f2-318ebf92819f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:29.188180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90596a93-bb0f-4fbf-a8f2-318ebf92819f service swift] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:29.188180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90596a93-bb0f-4fbf-a8f2-318ebf92819f service swift] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:29.188180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90596a93-bb0f-4fbf-a8f2-318ebf92819f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:29.196734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90596a93-bb0f-4fbf-a8f2-318ebf92819f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:29.198941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90596a93-bb0f-4fbf-a8f2-318ebf92819f service swift] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:29.207230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1320/2657] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:36:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:36:43.297885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614d319-305e-44be-b9cf-cfe472dd2810 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:43.299313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-5614d319-305e-44be-b9cf-cfe472dd2810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:43.359698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614d319-305e-44be-b9cf-cfe472dd2810 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:43.363183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1df2ae-1d27-4182-8ad6-fa505dd5942e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:43.363819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1df2ae-1d27-4182-8ad6-fa505dd5942e service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:43.364098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1df2ae-1d27-4182-8ad6-fa505dd5942e service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:43.364371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1df2ae-1d27-4182-8ad6-fa505dd5942e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:43.366276 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-cf1df2ae-1d27-4182-8ad6-fa505dd5942e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:43.377905 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1df2ae-1d27-4182-8ad6-fa505dd5942e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:43.379388 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1df2ae-1d27-4182-8ad6-fa505dd5942e service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:43.388447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1338/2658] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:43.485937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8c62f-5d66-4e62-92b6-94ed50635082 None None] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:43.486552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8c62f-5d66-4e62-92b6-94ed50635082 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:43.487393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8c62f-5d66-4e62-92b6-94ed50635082 None None] PATH_INFO: `/` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:43.489504 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1321/2659] 10.222.0.16 () {54 vars in 921 bytes} [Thu Mar 10 17:36:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 17:36:43.495870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad09a2-4b36-4604-9464-2354b8ba65a3 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:43.496271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad09a2-4b36-4604-9464-2354b8ba65a3 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:43.496616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad09a2-4b36-4604-9464-2354b8ba65a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:43.517025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-43ad09a2-4b36-4604-9464-2354b8ba65a3 None None] MFA Rules not processed for user `89a64b4a57114f77a231a31e16b3923e`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:43.518291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-43ad09a2-4b36-4604-9464-2354b8ba65a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:43.589924 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1339/2660] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Mar 10 17:36:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:43.601953 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8c62f-5d66-4e62-92b6-94ed50635082 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:43.603773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b9e8c62f-5d66-4e62-92b6-94ed50635082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:43.669753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8c62f-5d66-4e62-92b6-94ed50635082 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:43.673285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139af9a-bb59-4c25-929d-998901f99d4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9a11df2d3d4dc292a5115de69bb288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:43.673925 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139af9a-bb59-4c25-929d-998901f99d4f service glance] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:43.674235 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139af9a-bb59-4c25-929d-998901f99d4f service glance] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:43.674509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139af9a-bb59-4c25-929d-998901f99d4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:43.684708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139af9a-bb59-4c25-929d-998901f99d4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:43.686153 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139af9a-bb59-4c25-929d-998901f99d4f service glance] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:43.696768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1322/2661] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:36:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:36:45.586306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294d3c-2554-44f7-839d-b07f576fffcc None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:45.586847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294d3c-2554-44f7-839d-b07f576fffcc None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:45.586847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294d3c-2554-44f7-839d-b07f576fffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:45.604361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-94294d3c-2554-44f7-839d-b07f576fffcc None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:36:45.605556 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-94294d3c-2554-44f7-839d-b07f576fffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:36:45.612674 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1340/2662] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Mar 10 17:36:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:36:45.625216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139af9a-bb59-4c25-929d-998901f99d4f service glance] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:36:45.636704 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139af9a-bb59-4c25-929d-998901f99d4f service glance] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:36:45.641759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6c2f2-d761-49c0-9755-f973acea9650 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:36:45.642430 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6c2f2-d761-49c0-9755-f973acea9650 service swift] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:36:45.642714 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6c2f2-d761-49c0-9755-f973acea9650 service swift] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:36:45.642989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6c2f2-d761-49c0-9755-f973acea9650 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:36:45.651558 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6c2f2-d761-49c0-9755-f973acea9650 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:36:45.653113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6c2f2-d761-49c0-9755-f973acea9650 service swift] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:36:45.660886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1323/2663] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:36:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:37:17.675760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493cfdb-3c91-4e03-87b4-ffd227f07426 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:17.676313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493cfdb-3c91-4e03-87b4-ffd227f07426 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:17.676416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493cfdb-3c91-4e03-87b4-ffd227f07426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:17.705041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-b493cfdb-3c91-4e03-87b4-ffd227f07426 None None] MFA Rules not processed for user `e4f27325efd04f74b572def6a7060d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:17.706270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b493cfdb-3c91-4e03-87b4-ffd227f07426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:17.740740 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1341/2664] 10.222.0.16 () {58 vars in 967 bytes} [Thu Mar 10 17:37:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:17.754678 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6c2f2-d761-49c0-9755-f973acea9650 service swift] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:17.801034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6c2f2-d761-49c0-9755-f973acea9650 service swift] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:17.807210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c162e40-c435-44a1-a3af-02bad4c2b323 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc9fe9f62844a38f78d52435186f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:17.807852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c162e40-c435-44a1-a3af-02bad4c2b323 service swift] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:17.808242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c162e40-c435-44a1-a3af-02bad4c2b323 service swift] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:17.808519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c162e40-c435-44a1-a3af-02bad4c2b323 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:17.816886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c162e40-c435-44a1-a3af-02bad4c2b323 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:17.818505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c162e40-c435-44a1-a3af-02bad4c2b323 service swift] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:17.826602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1324/2665] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Mar 10 17:37:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 17:37:30.037240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493cfdb-3c91-4e03-87b4-ffd227f07426 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:30.038695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b493cfdb-3c91-4e03-87b4-ffd227f07426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:30.136474 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493cfdb-3c91-4e03-87b4-ffd227f07426 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:30.140950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:30.141836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:30.142094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:30.142405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] PATH_INFO: `/v3/users/b7a1e081efb0495f96aa44a116fb43bb` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:30.143563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a1e081efb0495f96aa44a116fb43bb)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:30.145446 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:30.188025 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a1e081efb0495f96aa44a116fb43bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.194817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a1e081efb0495f96aa44a116fb43bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.202648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a1e081efb0495f96aa44a116fb43bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.203278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a1e081efb0495f96aa44a116fb43bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.203880 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a1e081efb0495f96aa44a116fb43bb'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.220729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1342/2666] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:37:30 2022] DELETE /identity/v3/users/b7a1e081efb0495f96aa44a116fb43bb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:37:30.225093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcdebf-2e33-40f1-acab-60e2402a5953 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:30.225577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcdebf-2e33-40f1-acab-60e2402a5953 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:30.225680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcdebf-2e33-40f1-acab-60e2402a5953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:30.250362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-efbcdebf-2e33-40f1-acab-60e2402a5953 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:30.251546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-efbcdebf-2e33-40f1-acab-60e2402a5953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:30.309833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1325/2667] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:30.319815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:30.321255 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:30.402070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542cc7-deb6-449b-9715-9cc3f9feae41 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:30.406356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793520c4-0d58-4bc1-b13c-2140630eecd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:30.407973 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793520c4-0d58-4bc1-b13c-2140630eecd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:30.408132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793520c4-0d58-4bc1-b13c-2140630eecd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:30.408410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793520c4-0d58-4bc1-b13c-2140630eecd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:30.418647 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793520c4-0d58-4bc1-b13c-2140630eecd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:30.420108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793520c4-0d58-4bc1-b13c-2140630eecd4 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:30.429422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1343/2668] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:37:30.679143 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcdebf-2e33-40f1-acab-60e2402a5953 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:30.681227 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-efbcdebf-2e33-40f1-acab-60e2402a5953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:30.693669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcdebf-2e33-40f1-acab-60e2402a5953 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:30.700166 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:30.700871 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:30.701246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:30.701408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] PATH_INFO: `/v3/projects/af27e25d20994622b197710f967cc15c` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:30.703242 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af27e25d20994622b197710f967cc15c)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:30.705505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:30.755121 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af27e25d20994622b197710f967cc15c', 'request_id': 'req-1be3ff55-7783-404c-b8d3-83483adcb5e7'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.761593 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af27e25d20994622b197710f967cc15c', 'request_id': 'req-1be3ff55-7783-404c-b8d3-83483adcb5e7'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.769574 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af27e25d20994622b197710f967cc15c', 'request_id': 'req-1be3ff55-7783-404c-b8d3-83483adcb5e7'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.779686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] The token cache is being invalidate because project af27e25d20994622b197710f967cc15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:37:30.780001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.780666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.782488 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1326/2669] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:37:30 2022] DELETE /identity/v3/projects/af27e25d20994622b197710f967cc15c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:30.786504 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793520c4-0d58-4bc1-b13c-2140630eecd4 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:30.796418 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793520c4-0d58-4bc1-b13c-2140630eecd4 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:30.850123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:30.851009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:30.851290 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:30.851567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] PATH_INFO: `/v3/users/ab37ab8e9ea04c6ab20634d91120f53f` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:30.853236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab37ab8e9ea04c6ab20634d91120f53f)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:30.855169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:30.898780 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab37ab8e9ea04c6ab20634d91120f53f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.905269 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab37ab8e9ea04c6ab20634d91120f53f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.912199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab37ab8e9ea04c6ab20634d91120f53f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.912830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab37ab8e9ea04c6ab20634d91120f53f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.913437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1ae4335d-a7e3-4270-b878-76a2f211580d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab37ab8e9ea04c6ab20634d91120f53f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:30.930398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1344/2670] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:37:30 2022] DELETE /identity/v3/users/ab37ab8e9ea04c6ab20634d91120f53f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:31.194738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:31.196218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:31.216345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3ff55-7783-404c-b8d3-83483adcb5e7 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:31.271344 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:31.272462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.272742 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.273090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] PATH_INFO: `/v3/projects/45964d34c4be44dcaed15dceee6b0213` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.274234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] RBAC: Authorizing `identity:delete_project(project_id=45964d34c4be44dcaed15dceee6b0213)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:31.276648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:31.319873 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45964d34c4be44dcaed15dceee6b0213', 'request_id': 'req-12e891a8-4ee7-4bae-9a65-ca95ee65138d'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:31.325738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45964d34c4be44dcaed15dceee6b0213', 'request_id': 'req-12e891a8-4ee7-4bae-9a65-ca95ee65138d'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:31.332856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45964d34c4be44dcaed15dceee6b0213', 'request_id': 'req-12e891a8-4ee7-4bae-9a65-ca95ee65138d'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:31.343373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] The token cache is being invalidate because project 45964d34c4be44dcaed15dceee6b0213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:37:31.343659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:31.344266 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-12e891a8-4ee7-4bae-9a65-ca95ee65138d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:31.345788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1327/2671] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:37:31 2022] DELETE /identity/v3/projects/45964d34c4be44dcaed15dceee6b0213 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:31.350908 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23052d-ef15-4067-81b9-ff2a9879813b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.351414 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23052d-ef15-4067-81b9-ff2a9879813b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.351534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23052d-ef15-4067-81b9-ff2a9879813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.396757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8d23052d-ef15-4067-81b9-ff2a9879813b None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:31.398268 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8d23052d-ef15-4067-81b9-ff2a9879813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:31.457475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1345/2672] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:31.466040 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4316e-2e2d-4967-8cb1-1b6d1b73a3ef None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.466380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4316e-2e2d-4967-8cb1-1b6d1b73a3ef None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.466661 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4316e-2e2d-4967-8cb1-1b6d1b73a3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.486210 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-11d4316e-2e2d-4967-8cb1-1b6d1b73a3ef None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:31.487411 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-11d4316e-2e2d-4967-8cb1-1b6d1b73a3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:31.495316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1328/2673] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:31.499574 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23052d-ef15-4067-81b9-ff2a9879813b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:31.508928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23052d-ef15-4067-81b9-ff2a9879813b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:31.513361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430744e-b2a2-437f-aa6c-c92f5d683e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:31.514004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430744e-b2a2-437f-aa6c-c92f5d683e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.514326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430744e-b2a2-437f-aa6c-c92f5d683e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.514599 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430744e-b2a2-437f-aa6c-c92f5d683e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.515310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430744e-b2a2-437f-aa6c-c92f5d683e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:37:31.515641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430744e-b2a2-437f-aa6c-c92f5d683e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:31.517211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430744e-b2a2-437f-aa6c-c92f5d683e5b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:31.531234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1346/2674] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:37:31.535149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4316e-2e2d-4967-8cb1-1b6d1b73a3ef None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:31.545380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4316e-2e2d-4967-8cb1-1b6d1b73a3ef None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:31.550220 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7194e50-0afc-402a-bdf8-1a166e83cd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:31.550867 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7194e50-0afc-402a-bdf8-1a166e83cd3c admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.551173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7194e50-0afc-402a-bdf8-1a166e83cd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.551428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7194e50-0afc-402a-bdf8-1a166e83cd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.552119 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7194e50-0afc-402a-bdf8-1a166e83cd3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:31.554049 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7194e50-0afc-402a-bdf8-1a166e83cd3c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:31.578767 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1329/2675] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:37:31 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:37:31.582961 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430744e-b2a2-437f-aa6c-c92f5d683e5b admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:31.593238 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430744e-b2a2-437f-aa6c-c92f5d683e5b admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:31.645747 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930344b-1fa1-42ef-beb4-ee4b181b892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:31.646564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930344b-1fa1-42ef-beb4-ee4b181b892a admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.646858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930344b-1fa1-42ef-beb4-ee4b181b892a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.647384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930344b-1fa1-42ef-beb4-ee4b181b892a admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.648078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930344b-1fa1-42ef-beb4-ee4b181b892a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:31.650606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930344b-1fa1-42ef-beb4-ee4b181b892a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:31.668953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1347/2676] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:37:31 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:37:31.672984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7194e50-0afc-402a-bdf8-1a166e83cd3c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:31.682976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7194e50-0afc-402a-bdf8-1a166e83cd3c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:31.687544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc975b-48fa-4bd6-8d48-63b7552d4424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:31.688188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc975b-48fa-4bd6-8d48-63b7552d4424 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.688473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc975b-48fa-4bd6-8d48-63b7552d4424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.688768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc975b-48fa-4bd6-8d48-63b7552d4424 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.689472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc975b-48fa-4bd6-8d48-63b7552d4424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:31.691093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc975b-48fa-4bd6-8d48-63b7552d4424 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:31.701599 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1330/2677] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:31.706216 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930344b-1fa1-42ef-beb4-ee4b181b892a admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:31.716832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930344b-1fa1-42ef-beb4-ee4b181b892a admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:31.721374 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5fce7-1f37-4743-bf20-7cbadf12a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:31.722022 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5fce7-1f37-4743-bf20-7cbadf12a03d admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.722337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5fce7-1f37-4743-bf20-7cbadf12a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.722615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5fce7-1f37-4743-bf20-7cbadf12a03d admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.723331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5fce7-1f37-4743-bf20-7cbadf12a03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:31.724892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5fce7-1f37-4743-bf20-7cbadf12a03d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:31.734444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1348/2678] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:31.738420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc975b-48fa-4bd6-8d48-63b7552d4424 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:31.748254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc975b-48fa-4bd6-8d48-63b7552d4424 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:31.752817 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0b324-05b2-4d83-94a7-93bec1b4d973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:31.753678 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0b324-05b2-4d83-94a7-93bec1b4d973 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.753963 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0b324-05b2-4d83-94a7-93bec1b4d973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.754275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0b324-05b2-4d83-94a7-93bec1b4d973 admin admin] PATH_INFO: `/v3/projects/af33b9bd8db44cc494828cb025f2ae8f/users/9956061029ea48208cd160b973a49143/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.770347 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0b324-05b2-4d83-94a7-93bec1b4d973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af33b9bd8db44cc494828cb025f2ae8f, user_id=9956061029ea48208cd160b973a49143, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:31.773230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0b324-05b2-4d83-94a7-93bec1b4d973 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:31.786385 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1331/2679] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:31 2022] PUT /identity/v3/projects/af33b9bd8db44cc494828cb025f2ae8f/users/9956061029ea48208cd160b973a49143/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:31.797132 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c6813-ead4-4f63-89c6-64f64fc4a3f0 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.797423 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c6813-ead4-4f63-89c6-64f64fc4a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.797700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c6813-ead4-4f63-89c6-64f64fc4a3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.823850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f43c6813-ead4-4f63-89c6-64f64fc4a3f0 None None] MFA Rules not processed for user `9956061029ea48208cd160b973a49143`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:31.825058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f43c6813-ead4-4f63-89c6-64f64fc4a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:31.886124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1349/2680] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:31.890449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0b324-05b2-4d83-94a7-93bec1b4d973 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:31.950084 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0b324-05b2-4d83-94a7-93bec1b4d973 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:31.955005 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef748a65-fa9a-4459-9271-c7676f6b9535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:31.955662 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748a65-fa9a-4459-9271-c7676f6b9535 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:31.955947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748a65-fa9a-4459-9271-c7676f6b9535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:31.956250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748a65-fa9a-4459-9271-c7676f6b9535 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:31.956940 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef748a65-fa9a-4459-9271-c7676f6b9535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:31.958897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef748a65-fa9a-4459-9271-c7676f6b9535 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:31.982800 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1332/2681] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:37:31 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:37:31.986840 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c6813-ead4-4f63-89c6-64f64fc4a3f0 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:31.997801 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c6813-ead4-4f63-89c6-64f64fc4a3f0 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:32.049924 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8413310-f13d-410a-8963-0d29444d43dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:32.050635 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413310-f13d-410a-8963-0d29444d43dc admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:32.050914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413310-f13d-410a-8963-0d29444d43dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:32.051188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413310-f13d-410a-8963-0d29444d43dc admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:32.051864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8413310-f13d-410a-8963-0d29444d43dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:32.054077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8413310-f13d-410a-8963-0d29444d43dc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:32.073447 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1350/2682] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:37:31 2022] POST /identity/v3/users => generated 296 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:37:32.077359 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef748a65-fa9a-4459-9271-c7676f6b9535 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:32.087360 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef748a65-fa9a-4459-9271-c7676f6b9535 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:32.091938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146d7a-7188-4ba4-bf3a-ea0d063654ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:32.092584 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146d7a-7188-4ba4-bf3a-ea0d063654ea admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:32.092866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146d7a-7188-4ba4-bf3a-ea0d063654ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:32.093142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146d7a-7188-4ba4-bf3a-ea0d063654ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:32.093855 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146d7a-7188-4ba4-bf3a-ea0d063654ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:32.095600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146d7a-7188-4ba4-bf3a-ea0d063654ea admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:32.105719 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1333/2683] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:32.109553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8413310-f13d-410a-8963-0d29444d43dc admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:32.119812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8413310-f13d-410a-8963-0d29444d43dc admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:32.124340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26851c6-9ccc-4153-ada1-c2f9c78a9878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:32.125203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26851c6-9ccc-4153-ada1-c2f9c78a9878 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:32.125481 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26851c6-9ccc-4153-ada1-c2f9c78a9878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:32.125755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26851c6-9ccc-4153-ada1-c2f9c78a9878 admin admin] PATH_INFO: `/v3/projects/7e0c6a0238894c6c8a7cac49fc880b23/users/c4aa09e0d6d24ecf974229fa179b461a/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:32.143013 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26851c6-9ccc-4153-ada1-c2f9c78a9878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0c6a0238894c6c8a7cac49fc880b23, user_id=c4aa09e0d6d24ecf974229fa179b461a, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:32.145622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26851c6-9ccc-4153-ada1-c2f9c78a9878 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:32.159475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1351/2684] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:32 2022] PUT /identity/v3/projects/7e0c6a0238894c6c8a7cac49fc880b23/users/c4aa09e0d6d24ecf974229fa179b461a/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:32.163443 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146d7a-7188-4ba4-bf3a-ea0d063654ea admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:32.173178 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146d7a-7188-4ba4-bf3a-ea0d063654ea admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:32.227080 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc7ef2-6dab-47e9-8681-0f53f566af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:32.228294 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc7ef2-6dab-47e9-8681-0f53f566af99 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:32.228578 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc7ef2-6dab-47e9-8681-0f53f566af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:32.228849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc7ef2-6dab-47e9-8681-0f53f566af99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:32.229564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc7ef2-6dab-47e9-8681-0f53f566af99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:32.231194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc7ef2-6dab-47e9-8681-0f53f566af99 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:32.241939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1334/2685] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:32.245772 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26851c6-9ccc-4153-ada1-c2f9c78a9878 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:32.256283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26851c6-9ccc-4153-ada1-c2f9c78a9878 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:32.261109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931024c3-2dcc-46c3-bc9b-371a5f99a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:32.262090 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931024c3-2dcc-46c3-bc9b-371a5f99a3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:32.262477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931024c3-2dcc-46c3-bc9b-371a5f99a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:32.262825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931024c3-2dcc-46c3-bc9b-371a5f99a3a6 admin admin] PATH_INFO: `/v3/projects/7e0c6a0238894c6c8a7cac49fc880b23/users/c4aa09e0d6d24ecf974229fa179b461a/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:32.264981 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931024c3-2dcc-46c3-bc9b-371a5f99a3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0c6a0238894c6c8a7cac49fc880b23, user_id=c4aa09e0d6d24ecf974229fa179b461a, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:32.267785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931024c3-2dcc-46c3-bc9b-371a5f99a3a6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:32.278993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1352/2686] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:32 2022] PUT /identity/v3/projects/7e0c6a0238894c6c8a7cac49fc880b23/users/c4aa09e0d6d24ecf974229fa179b461a/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:32.296926 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78b3b-27ba-4bc9-bd42-5fde484c07ba None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:32.297458 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78b3b-27ba-4bc9-bd42-5fde484c07ba None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:32.297556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78b3b-27ba-4bc9-bd42-5fde484c07ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:32.327506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3ae78b3b-27ba-4bc9-bd42-5fde484c07ba None None] MFA Rules not processed for user `c4aa09e0d6d24ecf974229fa179b461a`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:32.328847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3ae78b3b-27ba-4bc9-bd42-5fde484c07ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:32.397828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1335/2687] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:32.409494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931024c3-2dcc-46c3-bc9b-371a5f99a3a6 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:32.411314 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-931024c3-2dcc-46c3-bc9b-371a5f99a3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:32.466040 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931024c3-2dcc-46c3-bc9b-371a5f99a3a6 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:32.469660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a3cbd-94a3-4a8b-ac18-a00740d303a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:32.470329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a3cbd-94a3-4a8b-ac18-a00740d303a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:32.470643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a3cbd-94a3-4a8b-ac18-a00740d303a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:32.470921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a3cbd-94a3-4a8b-ac18-a00740d303a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:32.479573 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a3cbd-94a3-4a8b-ac18-a00740d303a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:32.481012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a3cbd-94a3-4a8b-ac18-a00740d303a9 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:32.490071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1353/2688] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:37:32.561222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78b3b-27ba-4bc9-bd42-5fde484c07ba None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:32.571062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78b3b-27ba-4bc9-bd42-5fde484c07ba None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:32.575698 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e077e6-571d-44e9-9af6-12e04a0dfbfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:32.576334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e077e6-571d-44e9-9af6-12e04a0dfbfa service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:32.576672 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e077e6-571d-44e9-9af6-12e04a0dfbfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:32.576985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e077e6-571d-44e9-9af6-12e04a0dfbfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:32.634507 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e077e6-571d-44e9-9af6-12e04a0dfbfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:32.635955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e077e6-571d-44e9-9af6-12e04a0dfbfa service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:32.645677 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1336/2689] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:37:33.376898 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a3cbd-94a3-4a8b-ac18-a00740d303a9 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:33.378363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-612a3cbd-94a3-4a8b-ac18-a00740d303a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:33.442405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a3cbd-94a3-4a8b-ac18-a00740d303a9 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:33.446992 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:33.447860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:33.448144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:33.448445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] PATH_INFO: `/v3/users/04168be3f8f54f10acaf9a282549deec` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:33.449645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] RBAC: Authorizing `identity:delete_user(user_id=04168be3f8f54f10acaf9a282549deec)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:33.451561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:33.496949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04168be3f8f54f10acaf9a282549deec'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:33.503619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04168be3f8f54f10acaf9a282549deec'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:33.511329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04168be3f8f54f10acaf9a282549deec'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:33.512112 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04168be3f8f54f10acaf9a282549deec'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:33.512723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04168be3f8f54f10acaf9a282549deec'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:33.530326 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1354/2690] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:37:33 2022] DELETE /identity/v3/users/04168be3f8f54f10acaf9a282549deec => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:33.535063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b87fd-25b9-4ef2-801d-801f90143176 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:33.535547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b87fd-25b9-4ef2-801d-801f90143176 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:33.535679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b87fd-25b9-4ef2-801d-801f90143176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:33.553624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-6e4b87fd-25b9-4ef2-801d-801f90143176 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:33.554866 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6e4b87fd-25b9-4ef2-801d-801f90143176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:33.614509 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1337/2691] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:33.624144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:33.625554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:33.683848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80338-9bf6-48da-ac14-ce6e1b3716df admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:33.687512 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855270-83dc-47e3-81a7-e4292c9166f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:33.688158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855270-83dc-47e3-81a7-e4292c9166f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:33.688442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855270-83dc-47e3-81a7-e4292c9166f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:33.688720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855270-83dc-47e3-81a7-e4292c9166f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:33.698070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855270-83dc-47e3-81a7-e4292c9166f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:33.699511 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855270-83dc-47e3-81a7-e4292c9166f1 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:33.708940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1355/2692] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:37:33.992750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b87fd-25b9-4ef2-801d-801f90143176 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:33.994429 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6e4b87fd-25b9-4ef2-801d-801f90143176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:34.007040 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b87fd-25b9-4ef2-801d-801f90143176 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:34.013207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:34.014263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:34.014622 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:34.014972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] PATH_INFO: `/v3/projects/7faedd79b7b74eb189b7b44480c22f3d` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:34.016229 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7faedd79b7b74eb189b7b44480c22f3d)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:34.018302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:34.066413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7faedd79b7b74eb189b7b44480c22f3d', 'request_id': 'req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:34.074491 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7faedd79b7b74eb189b7b44480c22f3d', 'request_id': 'req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:34.082740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7faedd79b7b74eb189b7b44480c22f3d', 'request_id': 'req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:34.094309 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] The token cache is being invalidate because project 7faedd79b7b74eb189b7b44480c22f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:37:34.094784 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:34.095524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4eb0fc96-3944-4bc5-9e8e-a7c9c41f21e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:34.097355 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1338/2693] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:37:33 2022] DELETE /identity/v3/projects/7faedd79b7b74eb189b7b44480c22f3d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:43.408397 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855270-83dc-47e3-81a7-e4292c9166f1 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:43.409832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8b855270-83dc-47e3-81a7-e4292c9166f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:43.422384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855270-83dc-47e3-81a7-e4292c9166f1 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:43.476435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:43.477328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:43.477607 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:43.477875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] PATH_INFO: `/v3/users/9956061029ea48208cd160b973a49143` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:43.479071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9956061029ea48208cd160b973a49143)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:43.480966 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:43.526289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9956061029ea48208cd160b973a49143'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:43.533005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9956061029ea48208cd160b973a49143'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:43.540929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9956061029ea48208cd160b973a49143'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:43.541535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9956061029ea48208cd160b973a49143'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:43.542157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9956061029ea48208cd160b973a49143'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:43.559794 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1356/2694] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:37:43 2022] DELETE /identity/v3/users/9956061029ea48208cd160b973a49143 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:43.564236 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327368a-f0bc-43e4-b300-165316c94f0c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:43.564737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327368a-f0bc-43e4-b300-165316c94f0c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:43.564837 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327368a-f0bc-43e4-b300-165316c94f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:43.581807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-7327368a-f0bc-43e4-b300-165316c94f0c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:43.583025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7327368a-f0bc-43e4-b300-165316c94f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:43.639255 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1339/2695] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:37:43.648968 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:43.650499 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:43.705691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57b79-3e9a-4745-b42a-9286ac850ad0 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:43.709345 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f893a-2041-4b86-9c11-00e2ec9eefa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:43.709985 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f893a-2041-4b86-9c11-00e2ec9eefa5 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:43.710300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f893a-2041-4b86-9c11-00e2ec9eefa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:43.710579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f893a-2041-4b86-9c11-00e2ec9eefa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:43.719482 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f893a-2041-4b86-9c11-00e2ec9eefa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:43.720912 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f893a-2041-4b86-9c11-00e2ec9eefa5 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:43.730699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1357/2696] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:37:43.981731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327368a-f0bc-43e4-b300-165316c94f0c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:43.983234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7327368a-f0bc-43e4-b300-165316c94f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:43.996656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327368a-f0bc-43e4-b300-165316c94f0c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:44.001159 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:44.002825 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.003232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.003377 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] PATH_INFO: `/v3/projects/af33b9bd8db44cc494828cb025f2ae8f` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.004559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af33b9bd8db44cc494828cb025f2ae8f)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:44.006486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:44.052070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af33b9bd8db44cc494828cb025f2ae8f', 'request_id': 'req-13626634-c7bd-4e83-8bca-d2b46d660796'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.058149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af33b9bd8db44cc494828cb025f2ae8f', 'request_id': 'req-13626634-c7bd-4e83-8bca-d2b46d660796'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.065500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af33b9bd8db44cc494828cb025f2ae8f', 'request_id': 'req-13626634-c7bd-4e83-8bca-d2b46d660796'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.075292 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] The token cache is being invalidate because project af33b9bd8db44cc494828cb025f2ae8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:37:44.075582 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.076196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.077695 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1340/2697] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:37:43 2022] DELETE /identity/v3/projects/af33b9bd8db44cc494828cb025f2ae8f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:44.081626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f893a-2041-4b86-9c11-00e2ec9eefa5 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:44.091513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f893a-2041-4b86-9c11-00e2ec9eefa5 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:44.144074 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:44.144952 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.145239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.145515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] PATH_INFO: `/v3/users/c4aa09e0d6d24ecf974229fa179b461a` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.146705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4aa09e0d6d24ecf974229fa179b461a)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:44.148877 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:44.192384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4aa09e0d6d24ecf974229fa179b461a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.198847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4aa09e0d6d24ecf974229fa179b461a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.205687 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4aa09e0d6d24ecf974229fa179b461a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.206315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4aa09e0d6d24ecf974229fa179b461a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.206914 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-a3d7acb1-c3ba-46f3-8a38-af5e8b6b96d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4aa09e0d6d24ecf974229fa179b461a'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.223548 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1358/2698] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:37:44 2022] DELETE /identity/v3/users/c4aa09e0d6d24ecf974229fa179b461a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:44.487851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:44.490090 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:44.503600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626634-c7bd-4e83-8bca-d2b46d660796 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:44.557888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:44.558769 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.559058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.559336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] PATH_INFO: `/v3/projects/7e0c6a0238894c6c8a7cac49fc880b23` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.560492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0c6a0238894c6c8a7cac49fc880b23)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:44.562413 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:44.605870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0c6a0238894c6c8a7cac49fc880b23', 'request_id': 'req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.611892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0c6a0238894c6c8a7cac49fc880b23', 'request_id': 'req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.619052 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0c6a0238894c6c8a7cac49fc880b23', 'request_id': 'req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.629334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] The token cache is being invalidate because project 7e0c6a0238894c6c8a7cac49fc880b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:37:44.629623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.630314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1cb7f18c-7d06-4582-ac08-4fbf749f79bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:44.631882 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1341/2699] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:37:44 2022] DELETE /identity/v3/projects/7e0c6a0238894c6c8a7cac49fc880b23 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:37:44.637336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b93700-927e-4145-9b14-0be98e286679 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.637817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b93700-927e-4145-9b14-0be98e286679 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.637922 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b93700-927e-4145-9b14-0be98e286679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.656445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-73b93700-927e-4145-9b14-0be98e286679 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:44.657633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-73b93700-927e-4145-9b14-0be98e286679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:44.713469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1359/2700] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:44.721373 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533626b-2176-43b3-83cf-f98b32927660 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.721663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533626b-2176-43b3-83cf-f98b32927660 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.721941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533626b-2176-43b3-83cf-f98b32927660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.739609 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d533626b-2176-43b3-83cf-f98b32927660 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:44.740721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d533626b-2176-43b3-83cf-f98b32927660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:44.748908 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1342/2701] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:44.752921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b93700-927e-4145-9b14-0be98e286679 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:44.762858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b93700-927e-4145-9b14-0be98e286679 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:44.767357 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b9b9a-5bfb-46bd-871b-51770b6dcf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:44.768000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b9b9a-5bfb-46bd-871b-51770b6dcf3b admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.768286 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b9b9a-5bfb-46bd-871b-51770b6dcf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.768565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b9b9a-5bfb-46bd-871b-51770b6dcf3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.769294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b9b9a-5bfb-46bd-871b-51770b6dcf3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:37:44.769592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b9b9a-5bfb-46bd-871b-51770b6dcf3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:44.771218 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b9b9a-5bfb-46bd-871b-51770b6dcf3b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:44.782948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1360/2702] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:37:44.787686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533626b-2176-43b3-83cf-f98b32927660 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:44.796660 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533626b-2176-43b3-83cf-f98b32927660 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:44.801200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7db0a5-8f7d-4749-b9f4-90e69c0be1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:44.801836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7db0a5-8f7d-4749-b9f4-90e69c0be1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.802129 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7db0a5-8f7d-4749-b9f4-90e69c0be1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.802419 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7db0a5-8f7d-4749-b9f4-90e69c0be1a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.803106 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7db0a5-8f7d-4749-b9f4-90e69c0be1a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:44.804988 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7db0a5-8f7d-4749-b9f4-90e69c0be1a5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:44.829492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1343/2703] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:37:44 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:37:44.833683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b9b9a-5bfb-46bd-871b-51770b6dcf3b admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:44.843870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b9b9a-5bfb-46bd-871b-51770b6dcf3b admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:44.901902 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa800-4c1e-41d9-8b95-93d2d2c44cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:44.902606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa800-4c1e-41d9-8b95-93d2d2c44cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.902892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa800-4c1e-41d9-8b95-93d2d2c44cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.903171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa800-4c1e-41d9-8b95-93d2d2c44cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.903850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa800-4c1e-41d9-8b95-93d2d2c44cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:44.905730 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa800-4c1e-41d9-8b95-93d2d2c44cf2 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:44.925109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1361/2704] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:37:44 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:37:44.929196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7db0a5-8f7d-4749-b9f4-90e69c0be1a5 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:44.939218 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7db0a5-8f7d-4749-b9f4-90e69c0be1a5 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:44.943724 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664211a-7deb-4c13-bb27-d69718f22e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:44.944366 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664211a-7deb-4c13-bb27-d69718f22e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.944648 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664211a-7deb-4c13-bb27-d69718f22e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.944921 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664211a-7deb-4c13-bb27-d69718f22e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.945631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664211a-7deb-4c13-bb27-d69718f22e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:44.947263 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664211a-7deb-4c13-bb27-d69718f22e67 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:44.957396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1344/2705] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:44.961233 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa800-4c1e-41d9-8b95-93d2d2c44cf2 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:44.971839 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa800-4c1e-41d9-8b95-93d2d2c44cf2 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:44.976451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d751-e252-4b34-9199-2a284a5e5a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:44.977114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d751-e252-4b34-9199-2a284a5e5a52 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:44.977480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d751-e252-4b34-9199-2a284a5e5a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:44.978315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d751-e252-4b34-9199-2a284a5e5a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:44.979039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d751-e252-4b34-9199-2a284a5e5a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:44.980623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d751-e252-4b34-9199-2a284a5e5a52 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:44.990608 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1362/2706] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:44.994707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664211a-7deb-4c13-bb27-d69718f22e67 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:45.004331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664211a-7deb-4c13-bb27-d69718f22e67 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:45.008893 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33417d-d36c-47af-ba50-824a7effef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:45.009753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33417d-d36c-47af-ba50-824a7effef14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.010036 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33417d-d36c-47af-ba50-824a7effef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.010354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33417d-d36c-47af-ba50-824a7effef14 admin admin] PATH_INFO: `/v3/projects/987ec9649f3f40cda47fd2e5c8e94f42/users/1d49d4e4edae483ba0eb163dadbdb780/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.024891 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33417d-d36c-47af-ba50-824a7effef14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987ec9649f3f40cda47fd2e5c8e94f42, user_id=1d49d4e4edae483ba0eb163dadbdb780, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:45.027543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33417d-d36c-47af-ba50-824a7effef14 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:45.040128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1345/2707] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:44 2022] PUT /identity/v3/projects/987ec9649f3f40cda47fd2e5c8e94f42/users/1d49d4e4edae483ba0eb163dadbdb780/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:37:45.051309 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d1cdf-dceb-4154-a924-5963e6b2f211 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.051606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d1cdf-dceb-4154-a924-5963e6b2f211 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.051888 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d1cdf-dceb-4154-a924-5963e6b2f211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.081661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-640d1cdf-dceb-4154-a924-5963e6b2f211 None None] MFA Rules not processed for user `1d49d4e4edae483ba0eb163dadbdb780`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:45.082944 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-640d1cdf-dceb-4154-a924-5963e6b2f211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:45.144313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1363/2708] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:45.150039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33417d-d36c-47af-ba50-824a7effef14 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:45.207741 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33417d-d36c-47af-ba50-824a7effef14 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:45.212955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fb0d-851d-495b-9ad3-30b57282de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:45.213596 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fb0d-851d-495b-9ad3-30b57282de5b admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.213878 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fb0d-851d-495b-9ad3-30b57282de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.214197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fb0d-851d-495b-9ad3-30b57282de5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.214872 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21fb0d-851d-495b-9ad3-30b57282de5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:45.216755 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21fb0d-851d-495b-9ad3-30b57282de5b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:45.241379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1346/2709] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:37:45 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:37:45.245178 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d1cdf-dceb-4154-a924-5963e6b2f211 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:45.255736 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d1cdf-dceb-4154-a924-5963e6b2f211 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:45.311489 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1e9a8-6185-4ec2-8ddf-25c27fc7e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:45.312164 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1e9a8-6185-4ec2-8ddf-25c27fc7e693 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.312450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1e9a8-6185-4ec2-8ddf-25c27fc7e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.312729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1e9a8-6185-4ec2-8ddf-25c27fc7e693 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.313424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1e9a8-6185-4ec2-8ddf-25c27fc7e693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:45.315355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1e9a8-6185-4ec2-8ddf-25c27fc7e693 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:45.335406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1364/2710] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:37:45 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:37:45.339436 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fb0d-851d-495b-9ad3-30b57282de5b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:45.349414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fb0d-851d-495b-9ad3-30b57282de5b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:45.354546 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515588bc-61b3-43f0-876d-243ca6416efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:45.355192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515588bc-61b3-43f0-876d-243ca6416efb admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.355475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515588bc-61b3-43f0-876d-243ca6416efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.355752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515588bc-61b3-43f0-876d-243ca6416efb admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.356468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515588bc-61b3-43f0-876d-243ca6416efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:45.358047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515588bc-61b3-43f0-876d-243ca6416efb admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:45.369192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1347/2711] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:45.373098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1e9a8-6185-4ec2-8ddf-25c27fc7e693 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:45.382763 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1e9a8-6185-4ec2-8ddf-25c27fc7e693 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:45.387405 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6db28-7ddd-4c06-bd3f-954de7aba3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:45.388270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6db28-7ddd-4c06-bd3f-954de7aba3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.388567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6db28-7ddd-4c06-bd3f-954de7aba3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.388829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6db28-7ddd-4c06-bd3f-954de7aba3d4 admin admin] PATH_INFO: `/v3/projects/fb269a4d7b6c4e1f9a1afc8d73dc58af/users/67ffc92159044824b3c6a3c8ef4d82de/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.403131 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6db28-7ddd-4c06-bd3f-954de7aba3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb269a4d7b6c4e1f9a1afc8d73dc58af, user_id=67ffc92159044824b3c6a3c8ef4d82de, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:45.405744 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6db28-7ddd-4c06-bd3f-954de7aba3d4 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:45.418410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1365/2712] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:45 2022] PUT /identity/v3/projects/fb269a4d7b6c4e1f9a1afc8d73dc58af/users/67ffc92159044824b3c6a3c8ef4d82de/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:37:45.422248 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515588bc-61b3-43f0-876d-243ca6416efb admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:45.432092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515588bc-61b3-43f0-876d-243ca6416efb admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:45.485760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21362255-d989-4126-938f-dcbdb950f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:45.486453 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21362255-d989-4126-938f-dcbdb950f643 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.486743 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21362255-d989-4126-938f-dcbdb950f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.487020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21362255-d989-4126-938f-dcbdb950f643 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.487734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21362255-d989-4126-938f-dcbdb950f643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:45.489322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21362255-d989-4126-938f-dcbdb950f643 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:45.498765 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1348/2713] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:45.502771 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6db28-7ddd-4c06-bd3f-954de7aba3d4 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:45.512753 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6db28-7ddd-4c06-bd3f-954de7aba3d4 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:45.517356 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371d529-1912-4d17-a55c-ad5a245330eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:45.518278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d529-1912-4d17-a55c-ad5a245330eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.518564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d529-1912-4d17-a55c-ad5a245330eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.518842 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d529-1912-4d17-a55c-ad5a245330eb admin admin] PATH_INFO: `/v3/projects/fb269a4d7b6c4e1f9a1afc8d73dc58af/users/67ffc92159044824b3c6a3c8ef4d82de/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.520805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371d529-1912-4d17-a55c-ad5a245330eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb269a4d7b6c4e1f9a1afc8d73dc58af, user_id=67ffc92159044824b3c6a3c8ef4d82de, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:45.523720 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371d529-1912-4d17-a55c-ad5a245330eb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:45.534174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1366/2714] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:45 2022] PUT /identity/v3/projects/fb269a4d7b6c4e1f9a1afc8d73dc58af/users/67ffc92159044824b3c6a3c8ef4d82de/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:45.544612 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9cf25-4a2c-465c-824c-705152655d44 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.544905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9cf25-4a2c-465c-824c-705152655d44 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.545188 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9cf25-4a2c-465c-824c-705152655d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.570844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-37f9cf25-4a2c-465c-824c-705152655d44 None None] MFA Rules not processed for user `67ffc92159044824b3c6a3c8ef4d82de`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:45.572046 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-37f9cf25-4a2c-465c-824c-705152655d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:45.637024 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1349/2715] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:45.648800 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371d529-1912-4d17-a55c-ad5a245330eb admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:45.650570 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8371d529-1912-4d17-a55c-ad5a245330eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:45.705733 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371d529-1912-4d17-a55c-ad5a245330eb admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:45.709381 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4efb76-3049-4453-945c-6b83ce1eae48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:45.710018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4efb76-3049-4453-945c-6b83ce1eae48 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.710336 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4efb76-3049-4453-945c-6b83ce1eae48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.710619 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4efb76-3049-4453-945c-6b83ce1eae48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.719469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4efb76-3049-4453-945c-6b83ce1eae48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:45.721047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4efb76-3049-4453-945c-6b83ce1eae48 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:45.730563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1367/2716] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 17:37:45.798758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9cf25-4a2c-465c-824c-705152655d44 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:45.808852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9cf25-4a2c-465c-824c-705152655d44 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:45.812524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0508ece-a57e-4a4d-89aa-9b86065672d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:45.813156 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0508ece-a57e-4a4d-89aa-9b86065672d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:45.813444 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0508ece-a57e-4a4d-89aa-9b86065672d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:45.813724 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0508ece-a57e-4a4d-89aa-9b86065672d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:45.867180 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0508ece-a57e-4a4d-89aa-9b86065672d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:45.869176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0508ece-a57e-4a4d-89aa-9b86065672d0 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:45.878114 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1350/2717] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:37:46.122127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4efb76-3049-4453-945c-6b83ce1eae48 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:46.182823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4efb76-3049-4453-945c-6b83ce1eae48 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:46.187309 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:46.188175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:46.188461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:46.188738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] PATH_INFO: `/v3/users/1d49d4e4edae483ba0eb163dadbdb780` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:46.189904 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d49d4e4edae483ba0eb163dadbdb780)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:46.191857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:46.235285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d49d4e4edae483ba0eb163dadbdb780'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.241820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d49d4e4edae483ba0eb163dadbdb780'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.249299 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d49d4e4edae483ba0eb163dadbdb780'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.249926 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d49d4e4edae483ba0eb163dadbdb780'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.250559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d49d4e4edae483ba0eb163dadbdb780'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.267567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1368/2718] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:37:46 2022] DELETE /identity/v3/users/1d49d4e4edae483ba0eb163dadbdb780 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:46.272295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ae91a-0fda-4ed4-94e6-3064bbf4d6d2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:46.272594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ae91a-0fda-4ed4-94e6-3064bbf4d6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:46.272881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ae91a-0fda-4ed4-94e6-3064bbf4d6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:46.293434 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-985ae91a-0fda-4ed4-94e6-3064bbf4d6d2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:46.294589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-985ae91a-0fda-4ed4-94e6-3064bbf4d6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:46.350631 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1351/2719] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:46.361274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:46.362701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:46.418578 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda7e4-35d6-43d0-b80e-d0886b587b4c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:46.422210 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e44c1d-e5ea-4c99-9265-a6563a90fd54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:46.422856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44c1d-e5ea-4c99-9265-a6563a90fd54 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:46.423145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44c1d-e5ea-4c99-9265-a6563a90fd54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:46.423426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44c1d-e5ea-4c99-9265-a6563a90fd54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:46.432214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e44c1d-e5ea-4c99-9265-a6563a90fd54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:46.433638 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e44c1d-e5ea-4c99-9265-a6563a90fd54 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:46.442849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1369/2720] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:37:46.700337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ae91a-0fda-4ed4-94e6-3064bbf4d6d2 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:46.701808 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-985ae91a-0fda-4ed4-94e6-3064bbf4d6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:46.714515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ae91a-0fda-4ed4-94e6-3064bbf4d6d2 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:46.719318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:46.720208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:46.720518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:46.720819 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] PATH_INFO: `/v3/projects/987ec9649f3f40cda47fd2e5c8e94f42` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:46.722013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=987ec9649f3f40cda47fd2e5c8e94f42)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:46.723947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:46.769524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987ec9649f3f40cda47fd2e5c8e94f42', 'request_id': 'req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.775721 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987ec9649f3f40cda47fd2e5c8e94f42', 'request_id': 'req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.782423 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987ec9649f3f40cda47fd2e5c8e94f42', 'request_id': 'req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.792543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] The token cache is being invalidate because project 987ec9649f3f40cda47fd2e5c8e94f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:37:46.792795 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.794272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.795571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1352/2721] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:37:46 2022] DELETE /identity/v3/projects/987ec9649f3f40cda47fd2e5c8e94f42 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:46.798921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e44c1d-e5ea-4c99-9265-a6563a90fd54 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:46.809189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e44c1d-e5ea-4c99-9265-a6563a90fd54 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:46.862696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:46.863572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:46.863867 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:46.864144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] PATH_INFO: `/v3/users/67ffc92159044824b3c6a3c8ef4d82de` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:46.865317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ffc92159044824b3c6a3c8ef4d82de)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:46.867264 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:46.914507 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ffc92159044824b3c6a3c8ef4d82de'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.921532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ffc92159044824b3c6a3c8ef4d82de'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.928302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ffc92159044824b3c6a3c8ef4d82de'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.928986 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ffc92159044824b3c6a3c8ef4d82de'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.929593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cfd8516c-487c-4a96-9a22-f52501763236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ffc92159044824b3c6a3c8ef4d82de'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:46.946462 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1370/2722] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:37:46 2022] DELETE /identity/v3/users/67ffc92159044824b3c6a3c8ef4d82de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:47.197897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:47.199485 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:47.215198 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fdbe2-6e07-40fc-9e96-d827de4b5610 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:47.269773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:47.270663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.270947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.271224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] PATH_INFO: `/v3/projects/fb269a4d7b6c4e1f9a1afc8d73dc58af` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.272693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb269a4d7b6c4e1f9a1afc8d73dc58af)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:47.275189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:47.320717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb269a4d7b6c4e1f9a1afc8d73dc58af', 'request_id': 'req-db8327cb-4b34-466f-8198-463ccc3a8bf4'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:47.327200 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb269a4d7b6c4e1f9a1afc8d73dc58af', 'request_id': 'req-db8327cb-4b34-466f-8198-463ccc3a8bf4'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:47.334527 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb269a4d7b6c4e1f9a1afc8d73dc58af', 'request_id': 'req-db8327cb-4b34-466f-8198-463ccc3a8bf4'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:47.345708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] The token cache is being invalidate because project fb269a4d7b6c4e1f9a1afc8d73dc58af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:37:47.345995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:47.346651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-db8327cb-4b34-466f-8198-463ccc3a8bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:47.348161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1353/2723] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:37:47 2022] DELETE /identity/v3/projects/fb269a4d7b6c4e1f9a1afc8d73dc58af => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:47.353067 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f6a13-0421-4b25-8f14-ed7a392d6040 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.353358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f6a13-0421-4b25-8f14-ed7a392d6040 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.353637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f6a13-0421-4b25-8f14-ed7a392d6040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.371237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-9d5f6a13-0421-4b25-8f14-ed7a392d6040 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:47.372412 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-9d5f6a13-0421-4b25-8f14-ed7a392d6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:47.429713 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1371/2724] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:47.437234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954cac9-eb6a-4ba0-a14b-2cec992215be None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.437547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954cac9-eb6a-4ba0-a14b-2cec992215be None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.437852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954cac9-eb6a-4ba0-a14b-2cec992215be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.455806 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-7954cac9-eb6a-4ba0-a14b-2cec992215be None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:47.456977 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-7954cac9-eb6a-4ba0-a14b-2cec992215be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:47.464783 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1354/2725] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:47.468726 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f6a13-0421-4b25-8f14-ed7a392d6040 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:47.478536 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f6a13-0421-4b25-8f14-ed7a392d6040 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:47.483173 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae288c1-9a9e-4a18-a412-395c28f36414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:47.483830 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae288c1-9a9e-4a18-a412-395c28f36414 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.484109 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae288c1-9a9e-4a18-a412-395c28f36414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.484381 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae288c1-9a9e-4a18-a412-395c28f36414 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.485101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae288c1-9a9e-4a18-a412-395c28f36414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:37:47.485408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae288c1-9a9e-4a18-a412-395c28f36414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:47.487012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae288c1-9a9e-4a18-a412-395c28f36414 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:47.498239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1372/2726] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:37:47.502461 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954cac9-eb6a-4ba0-a14b-2cec992215be None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:47.511838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954cac9-eb6a-4ba0-a14b-2cec992215be None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:47.516428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c210021-1147-425e-b0c1-dccc3834fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:47.517062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c210021-1147-425e-b0c1-dccc3834fc5d admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.517345 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c210021-1147-425e-b0c1-dccc3834fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.517623 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c210021-1147-425e-b0c1-dccc3834fc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.518329 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c210021-1147-425e-b0c1-dccc3834fc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:47.520368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c210021-1147-425e-b0c1-dccc3834fc5d admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:47.545075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1355/2727] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:37:47 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:37:47.549088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae288c1-9a9e-4a18-a412-395c28f36414 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:47.558900 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae288c1-9a9e-4a18-a412-395c28f36414 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:47.612758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e20840-7c83-46f0-afa3-d8fc3d295c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:47.613355 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e20840-7c83-46f0-afa3-d8fc3d295c9f admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.613639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e20840-7c83-46f0-afa3-d8fc3d295c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.613916 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e20840-7c83-46f0-afa3-d8fc3d295c9f admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.614651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e20840-7c83-46f0-afa3-d8fc3d295c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:47.616542 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e20840-7c83-46f0-afa3-d8fc3d295c9f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:47.636205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1373/2728] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:37:47 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:37:47.640247 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c210021-1147-425e-b0c1-dccc3834fc5d admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:47.650506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c210021-1147-425e-b0c1-dccc3834fc5d admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:47.655042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3400818-ab95-4615-9d18-0c762ec8cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:47.655684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3400818-ab95-4615-9d18-0c762ec8cb7b admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.655966 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3400818-ab95-4615-9d18-0c762ec8cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.656241 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3400818-ab95-4615-9d18-0c762ec8cb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.656950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3400818-ab95-4615-9d18-0c762ec8cb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:47.658569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3400818-ab95-4615-9d18-0c762ec8cb7b admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:47.669047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1356/2729] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:47.672799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e20840-7c83-46f0-afa3-d8fc3d295c9f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:47.682384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e20840-7c83-46f0-afa3-d8fc3d295c9f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:47.687008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84fc89-c054-4b83-80c3-09da68f092e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:47.687660 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84fc89-c054-4b83-80c3-09da68f092e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.687993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84fc89-c054-4b83-80c3-09da68f092e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.688310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84fc89-c054-4b83-80c3-09da68f092e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.689023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84fc89-c054-4b83-80c3-09da68f092e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:47.690868 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84fc89-c054-4b83-80c3-09da68f092e6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:47.701271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1374/2730] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:47.705428 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3400818-ab95-4615-9d18-0c762ec8cb7b admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:47.715852 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3400818-ab95-4615-9d18-0c762ec8cb7b admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:47.720502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d14767-7ac3-4701-9306-e8fc52bb22d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:47.721368 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d14767-7ac3-4701-9306-e8fc52bb22d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.721652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d14767-7ac3-4701-9306-e8fc52bb22d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.721928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d14767-7ac3-4701-9306-e8fc52bb22d6 admin admin] PATH_INFO: `/v3/projects/48e5d0826a2f456381336fd3d6352068/users/9d47b78f2d82414bba707f404e30bd71/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.736761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d14767-7ac3-4701-9306-e8fc52bb22d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e5d0826a2f456381336fd3d6352068, user_id=9d47b78f2d82414bba707f404e30bd71, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:47.739438 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d14767-7ac3-4701-9306-e8fc52bb22d6 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:47.752304 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1357/2731] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:47 2022] PUT /identity/v3/projects/48e5d0826a2f456381336fd3d6352068/users/9d47b78f2d82414bba707f404e30bd71/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:47.763538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93969c9b-7d78-4501-ac53-f12ca112f320 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.763860 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93969c9b-7d78-4501-ac53-f12ca112f320 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.764155 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93969c9b-7d78-4501-ac53-f12ca112f320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.790911 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-93969c9b-7d78-4501-ac53-f12ca112f320 None None] MFA Rules not processed for user `9d47b78f2d82414bba707f404e30bd71`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:47.792102 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-93969c9b-7d78-4501-ac53-f12ca112f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:47.853287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1375/2732] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:47.857861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d14767-7ac3-4701-9306-e8fc52bb22d6 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:47.916216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d14767-7ac3-4701-9306-e8fc52bb22d6 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:47.920706 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ac36f-dfe0-41a6-8fab-277c1ad352de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:47.921486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ac36f-dfe0-41a6-8fab-277c1ad352de admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:47.921771 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ac36f-dfe0-41a6-8fab-277c1ad352de admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:47.922041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ac36f-dfe0-41a6-8fab-277c1ad352de admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:47.922864 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ac36f-dfe0-41a6-8fab-277c1ad352de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:47.924737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ac36f-dfe0-41a6-8fab-277c1ad352de admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:47.948082 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1358/2733] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:37:47 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:37:47.952239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93969c9b-7d78-4501-ac53-f12ca112f320 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:47.963271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93969c9b-7d78-4501-ac53-f12ca112f320 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:48.016923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2000f-f61a-480d-b2e9-148a6a5dcd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:48.017596 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2000f-f61a-480d-b2e9-148a6a5dcd97 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:48.017881 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2000f-f61a-480d-b2e9-148a6a5dcd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:48.018189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2000f-f61a-480d-b2e9-148a6a5dcd97 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:48.018884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2000f-f61a-480d-b2e9-148a6a5dcd97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:48.020777 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2000f-f61a-480d-b2e9-148a6a5dcd97 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:48.042958 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1376/2734] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:37:47 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:37:48.047009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ac36f-dfe0-41a6-8fab-277c1ad352de admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:48.058528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ac36f-dfe0-41a6-8fab-277c1ad352de admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:48.063160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca81fde-f0cd-45a6-a2c8-325ec9def474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:48.063812 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81fde-f0cd-45a6-a2c8-325ec9def474 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:48.064096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81fde-f0cd-45a6-a2c8-325ec9def474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:48.064372 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81fde-f0cd-45a6-a2c8-325ec9def474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:48.065089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca81fde-f0cd-45a6-a2c8-325ec9def474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:48.066931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca81fde-f0cd-45a6-a2c8-325ec9def474 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:48.077775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1359/2735] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:48.081960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2000f-f61a-480d-b2e9-148a6a5dcd97 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:48.092156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2000f-f61a-480d-b2e9-148a6a5dcd97 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:48.096696 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f976-2cc1-4fda-8f6a-426e47b9606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:48.097569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f976-2cc1-4fda-8f6a-426e47b9606f admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:48.097857 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f976-2cc1-4fda-8f6a-426e47b9606f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:48.098158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f976-2cc1-4fda-8f6a-426e47b9606f admin admin] PATH_INFO: `/v3/projects/2c4e31f19656406da9c758518df1ab56/users/cf60bfacce344d57bfc41602e9ceabc1/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:48.112088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085f976-2cc1-4fda-8f6a-426e47b9606f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4e31f19656406da9c758518df1ab56, user_id=cf60bfacce344d57bfc41602e9ceabc1, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:48.114742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085f976-2cc1-4fda-8f6a-426e47b9606f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:48.127118 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1377/2736] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:48 2022] PUT /identity/v3/projects/2c4e31f19656406da9c758518df1ab56/users/cf60bfacce344d57bfc41602e9ceabc1/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:48.131094 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca81fde-f0cd-45a6-a2c8-325ec9def474 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:48.141230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca81fde-f0cd-45a6-a2c8-325ec9def474 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:48.194907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3947ef-e41d-4f42-8856-d7a3c5daac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:48.195489 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3947ef-e41d-4f42-8856-d7a3c5daac75 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:48.195775 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3947ef-e41d-4f42-8856-d7a3c5daac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:48.196577 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3947ef-e41d-4f42-8856-d7a3c5daac75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:48.197327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3947ef-e41d-4f42-8856-d7a3c5daac75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:48.198946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3947ef-e41d-4f42-8856-d7a3c5daac75 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:48.208216 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1360/2737] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:48.212875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f976-2cc1-4fda-8f6a-426e47b9606f admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:48.222822 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f976-2cc1-4fda-8f6a-426e47b9606f admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:48.227381 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30bdb-8129-4ed2-aa0d-5c854d7e795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:48.228285 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30bdb-8129-4ed2-aa0d-5c854d7e795b admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:48.228564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30bdb-8129-4ed2-aa0d-5c854d7e795b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:48.228833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30bdb-8129-4ed2-aa0d-5c854d7e795b admin admin] PATH_INFO: `/v3/projects/2c4e31f19656406da9c758518df1ab56/users/cf60bfacce344d57bfc41602e9ceabc1/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:48.230805 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b30bdb-8129-4ed2-aa0d-5c854d7e795b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4e31f19656406da9c758518df1ab56, user_id=cf60bfacce344d57bfc41602e9ceabc1, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:48.233398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b30bdb-8129-4ed2-aa0d-5c854d7e795b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:48.243122 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1378/2738] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:48 2022] PUT /identity/v3/projects/2c4e31f19656406da9c758518df1ab56/users/cf60bfacce344d57bfc41602e9ceabc1/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:48.252958 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe178418-3c8a-4c72-9070-cf4f5ee02559 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:48.253250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe178418-3c8a-4c72-9070-cf4f5ee02559 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:48.253533 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe178418-3c8a-4c72-9070-cf4f5ee02559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:48.280291 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-fe178418-3c8a-4c72-9070-cf4f5ee02559 None None] MFA Rules not processed for user `cf60bfacce344d57bfc41602e9ceabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:48.281543 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fe178418-3c8a-4c72-9070-cf4f5ee02559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:48.358684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1361/2739] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:48.369428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30bdb-8129-4ed2-aa0d-5c854d7e795b admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:48.371157 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-75b30bdb-8129-4ed2-aa0d-5c854d7e795b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:48.425953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30bdb-8129-4ed2-aa0d-5c854d7e795b admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:48.429576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e4346-a445-49dc-b179-9d168ce22af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:48.430271 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4346-a445-49dc-b179-9d168ce22af7 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:48.431048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4346-a445-49dc-b179-9d168ce22af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:48.431331 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4346-a445-49dc-b179-9d168ce22af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:48.484192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e4346-a445-49dc-b179-9d168ce22af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:48.485616 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e4346-a445-49dc-b179-9d168ce22af7 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:48.494937 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1379/2740] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:37:50.981834 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe178418-3c8a-4c72-9070-cf4f5ee02559 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:51.040955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe178418-3c8a-4c72-9070-cf4f5ee02559 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:51.045437 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:51.046320 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:51.046603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:51.046879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] PATH_INFO: `/v3/users/9d47b78f2d82414bba707f404e30bd71` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:51.048092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d47b78f2d82414bba707f404e30bd71)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:51.049946 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:51.094674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d47b78f2d82414bba707f404e30bd71'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.103063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d47b78f2d82414bba707f404e30bd71'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.103666 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d47b78f2d82414bba707f404e30bd71'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.110470 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d47b78f2d82414bba707f404e30bd71'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.122277 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d47b78f2d82414bba707f404e30bd71'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.127951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1362/2741] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:37:50 2022] DELETE /identity/v3/users/9d47b78f2d82414bba707f404e30bd71 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:51.132392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404134c1-8993-4963-9133-a992c8e4b58d None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:51.132845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404134c1-8993-4963-9133-a992c8e4b58d None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:51.132950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404134c1-8993-4963-9133-a992c8e4b58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:51.150214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-404134c1-8993-4963-9133-a992c8e4b58d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:51.151400 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-404134c1-8993-4963-9133-a992c8e4b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:51.208179 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1380/2742] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:51.217633 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:51.219020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:51.273951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd3a4b-64ef-42f6-ad3a-e5da7f774ec5 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:51.277549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0af54-7cf8-4af6-8e00-1856bad04e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:51.278221 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0af54-7cf8-4af6-8e00-1856bad04e03 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:51.278506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0af54-7cf8-4af6-8e00-1856bad04e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:51.278782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0af54-7cf8-4af6-8e00-1856bad04e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:51.287402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0af54-7cf8-4af6-8e00-1856bad04e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:51.288828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0af54-7cf8-4af6-8e00-1856bad04e03 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:51.298761 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1363/2743] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:37:51.556043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404134c1-8993-4963-9133-a992c8e4b58d None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:51.557540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-404134c1-8993-4963-9133-a992c8e4b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:51.569501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404134c1-8993-4963-9133-a992c8e4b58d None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:51.575378 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:51.576254 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:51.576538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:51.576817 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] PATH_INFO: `/v3/projects/48e5d0826a2f456381336fd3d6352068` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:51.578024 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e5d0826a2f456381336fd3d6352068)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:51.579953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:51.624249 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e5d0826a2f456381336fd3d6352068', 'request_id': 'req-fbf40602-f357-4643-9beb-8576fd83e7e6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.630812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e5d0826a2f456381336fd3d6352068', 'request_id': 'req-fbf40602-f357-4643-9beb-8576fd83e7e6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.637289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e5d0826a2f456381336fd3d6352068', 'request_id': 'req-fbf40602-f357-4643-9beb-8576fd83e7e6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.647282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] The token cache is being invalidate because project 48e5d0826a2f456381336fd3d6352068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:37:51.647572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.648200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.649735 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1381/2744] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:37:51 2022] DELETE /identity/v3/projects/48e5d0826a2f456381336fd3d6352068 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:51.653630 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0af54-7cf8-4af6-8e00-1856bad04e03 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:51.662933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0af54-7cf8-4af6-8e00-1856bad04e03 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:51.717019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:51.717883 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:51.718194 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:51.718471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] PATH_INFO: `/v3/users/cf60bfacce344d57bfc41602e9ceabc1` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:51.719651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf60bfacce344d57bfc41602e9ceabc1)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:51.721547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:51.764708 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf60bfacce344d57bfc41602e9ceabc1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.771823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf60bfacce344d57bfc41602e9ceabc1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.772760 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf60bfacce344d57bfc41602e9ceabc1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.779442 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf60bfacce344d57bfc41602e9ceabc1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.790895 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-39501e21-dbc4-46e2-9d3c-4540746f1eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf60bfacce344d57bfc41602e9ceabc1'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:51.796717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1364/2745] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:37:51 2022] DELETE /identity/v3/users/cf60bfacce344d57bfc41602e9ceabc1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:37:52.054565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:52.056628 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:52.074544 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40602-f357-4643-9beb-8576fd83e7e6 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:52.130426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:52.131277 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.131572 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.131838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] PATH_INFO: `/v3/projects/2c4e31f19656406da9c758518df1ab56` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.133004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4e31f19656406da9c758518df1ab56)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:52.134940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:52.180205 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4e31f19656406da9c758518df1ab56', 'request_id': 'req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:52.187802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4e31f19656406da9c758518df1ab56', 'request_id': 'req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:52.193861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4e31f19656406da9c758518df1ab56', 'request_id': 'req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:52.203683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] The token cache is being invalidate because project 2c4e31f19656406da9c758518df1ab56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:37:52.203967 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:52.204588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4dcd12c1-35c5-4d75-96e9-b3a414d3917f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:37:52.206120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1382/2746] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:37:52 2022] DELETE /identity/v3/projects/2c4e31f19656406da9c758518df1ab56 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:37:52.211002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bae71-ba22-4b6e-b199-fc3cf903c964 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.212019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bae71-ba22-4b6e-b199-fc3cf903c964 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.212127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bae71-ba22-4b6e-b199-fc3cf903c964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.230311 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a54bae71-ba22-4b6e-b199-fc3cf903c964 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:52.231503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a54bae71-ba22-4b6e-b199-fc3cf903c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:52.287009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1365/2747] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:52.296398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280d556-97e0-438c-9d49-17d007c7b6eb None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.296691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280d556-97e0-438c-9d49-17d007c7b6eb None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.296975 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280d556-97e0-438c-9d49-17d007c7b6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.315203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8280d556-97e0-438c-9d49-17d007c7b6eb None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:52.316398 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8280d556-97e0-438c-9d49-17d007c7b6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:52.324321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1383/2748] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:52.328595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bae71-ba22-4b6e-b199-fc3cf903c964 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:52.338516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bae71-ba22-4b6e-b199-fc3cf903c964 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:52.343065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3954-2e45-4dd8-991a-42c6e242c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:52.343710 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3954-2e45-4dd8-991a-42c6e242c033 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.343992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3954-2e45-4dd8-991a-42c6e242c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.344267 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3954-2e45-4dd8-991a-42c6e242c033 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.344982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc3954-2e45-4dd8-991a-42c6e242c033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:37:52.345288 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc3954-2e45-4dd8-991a-42c6e242c033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:52.346916 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc3954-2e45-4dd8-991a-42c6e242c033 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:52.358702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1366/2749] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:37:52.362591 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280d556-97e0-438c-9d49-17d007c7b6eb None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:52.371641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280d556-97e0-438c-9d49-17d007c7b6eb None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:52.376231 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873d29b-c436-49e5-89f5-154b1cc4a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:52.376873 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873d29b-c436-49e5-89f5-154b1cc4a8cb admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.377162 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873d29b-c436-49e5-89f5-154b1cc4a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.377442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873d29b-c436-49e5-89f5-154b1cc4a8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.378158 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873d29b-c436-49e5-89f5-154b1cc4a8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:52.380046 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873d29b-c436-49e5-89f5-154b1cc4a8cb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:52.404865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1384/2750] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:37:52 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:37:52.408758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3954-2e45-4dd8-991a-42c6e242c033 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:52.419058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3954-2e45-4dd8-991a-42c6e242c033 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:52.472733 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea55d29-857e-4f92-9ab0-a6ffcc8b2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:52.473388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea55d29-857e-4f92-9ab0-a6ffcc8b2818 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.473772 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea55d29-857e-4f92-9ab0-a6ffcc8b2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.473995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea55d29-857e-4f92-9ab0-a6ffcc8b2818 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.474672 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea55d29-857e-4f92-9ab0-a6ffcc8b2818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:52.476581 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea55d29-857e-4f92-9ab0-a6ffcc8b2818 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:52.495521 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1367/2751] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:37:52 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:37:52.499344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873d29b-c436-49e5-89f5-154b1cc4a8cb admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:52.509354 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873d29b-c436-49e5-89f5-154b1cc4a8cb admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:52.513909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240c468-5f3a-4553-927e-6e72b106b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:52.514601 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240c468-5f3a-4553-927e-6e72b106b672 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.514890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240c468-5f3a-4553-927e-6e72b106b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.515172 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240c468-5f3a-4553-927e-6e72b106b672 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.515890 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240c468-5f3a-4553-927e-6e72b106b672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:52.517488 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240c468-5f3a-4553-927e-6e72b106b672 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:52.528294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1385/2752] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:52.531974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea55d29-857e-4f92-9ab0-a6ffcc8b2818 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:52.542421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea55d29-857e-4f92-9ab0-a6ffcc8b2818 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:52.547989 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e1802-d0d5-455e-a59c-a32825f8eabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:52.548659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e1802-d0d5-455e-a59c-a32825f8eabf admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.548939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e1802-d0d5-455e-a59c-a32825f8eabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.549212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e1802-d0d5-455e-a59c-a32825f8eabf admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.549976 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e1802-d0d5-455e-a59c-a32825f8eabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:52.551614 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e1802-d0d5-455e-a59c-a32825f8eabf admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:52.561265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1368/2753] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:37:52.564935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240c468-5f3a-4553-927e-6e72b106b672 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:52.575204 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240c468-5f3a-4553-927e-6e72b106b672 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:52.579836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296a488-6fee-41b4-a206-08ffad02b7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:52.580637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296a488-6fee-41b4-a206-08ffad02b7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.580920 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296a488-6fee-41b4-a206-08ffad02b7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.581195 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296a488-6fee-41b4-a206-08ffad02b7d8 admin admin] PATH_INFO: `/v3/projects/973160cd8f914d3eab1b0c1f1d4609c4/users/24a2104ea2334d0cace3b1d2334d8703/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.595856 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296a488-6fee-41b4-a206-08ffad02b7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973160cd8f914d3eab1b0c1f1d4609c4, user_id=24a2104ea2334d0cace3b1d2334d8703, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:52.598508 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296a488-6fee-41b4-a206-08ffad02b7d8 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:52.611379 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1386/2754] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:37:52 2022] PUT /identity/v3/projects/973160cd8f914d3eab1b0c1f1d4609c4/users/24a2104ea2334d0cace3b1d2334d8703/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:37:52.621516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed1354-61be-42a0-aa90-3b9599d008a2 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.621807 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed1354-61be-42a0-aa90-3b9599d008a2 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.622086 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed1354-61be-42a0-aa90-3b9599d008a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.647815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-55ed1354-61be-42a0-aa90-3b9599d008a2 None None] MFA Rules not processed for user `24a2104ea2334d0cace3b1d2334d8703`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:37:52.649066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-55ed1354-61be-42a0-aa90-3b9599d008a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:52.708006 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1369/2755] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:37:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:37:52.719029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296a488-6fee-41b4-a206-08ffad02b7d8 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:37:52.720690 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e296a488-6fee-41b4-a206-08ffad02b7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:37:52.775103 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296a488-6fee-41b4-a206-08ffad02b7d8 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:37:52.778833 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ac0ad-3123-43ce-8b83-d2b5c134f8e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:37:52.779471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ac0ad-3123-43ce-8b83-d2b5c134f8e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:37:52.779755 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ac0ad-3123-43ce-8b83-d2b5c134f8e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:37:52.780031 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ac0ad-3123-43ce-8b83-d2b5c134f8e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:37:52.788078 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ac0ad-3123-43ce-8b83-d2b5c134f8e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:37:52.789472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ac0ad-3123-43ce-8b83-d2b5c134f8e6 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:37:52.798012 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1387/2756] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:37:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:02.688409 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed1354-61be-42a0-aa90-3b9599d008a2 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:02.747002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed1354-61be-42a0-aa90-3b9599d008a2 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:02.751467 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:02.752321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:02.752601 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:02.752875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] PATH_INFO: `/v3/users/24a2104ea2334d0cace3b1d2334d8703` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:02.754044 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a2104ea2334d0cace3b1d2334d8703)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:02.755972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:02.800851 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a2104ea2334d0cace3b1d2334d8703'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:02.807281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a2104ea2334d0cace3b1d2334d8703'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:02.808035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a2104ea2334d0cace3b1d2334d8703'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:02.814544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a2104ea2334d0cace3b1d2334d8703'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:02.825603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a2104ea2334d0cace3b1d2334d8703'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:02.831269 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1370/2757] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:38:02 2022] DELETE /identity/v3/users/24a2104ea2334d0cace3b1d2334d8703 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:02.835734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895cb60-19e3-4219-a81c-074718ff4b3c None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:02.836731 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895cb60-19e3-4219-a81c-074718ff4b3c None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:02.836838 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895cb60-19e3-4219-a81c-074718ff4b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:02.854275 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0895cb60-19e3-4219-a81c-074718ff4b3c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:02.855475 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0895cb60-19e3-4219-a81c-074718ff4b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:02.912050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1388/2758] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:02.922572 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:02.923941 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:02.979300 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f281f-0457-4d04-8342-8d0ce369e817 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:02.982954 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68b5c-2bb0-4735-90bb-5c670c98e9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:02.983594 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68b5c-2bb0-4735-90bb-5c670c98e9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:02.983879 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68b5c-2bb0-4735-90bb-5c670c98e9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:02.984186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68b5c-2bb0-4735-90bb-5c670c98e9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:02.993538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e68b5c-2bb0-4735-90bb-5c670c98e9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:02.995004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e68b5c-2bb0-4735-90bb-5c670c98e9d3 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:03.004516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1371/2759] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:03.255931 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895cb60-19e3-4219-a81c-074718ff4b3c None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:03.257534 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0895cb60-19e3-4219-a81c-074718ff4b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:03.276235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895cb60-19e3-4219-a81c-074718ff4b3c None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:03.281450 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:03.282379 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:03.282685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:03.282946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] PATH_INFO: `/v3/projects/973160cd8f914d3eab1b0c1f1d4609c4` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:03.284133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973160cd8f914d3eab1b0c1f1d4609c4)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:03.286014 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:03.331199 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973160cd8f914d3eab1b0c1f1d4609c4', 'request_id': 'req-087a573f-55bb-469f-a002-77cb6e4a2e51'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:03.339047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973160cd8f914d3eab1b0c1f1d4609c4', 'request_id': 'req-087a573f-55bb-469f-a002-77cb6e4a2e51'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:03.345144 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973160cd8f914d3eab1b0c1f1d4609c4', 'request_id': 'req-087a573f-55bb-469f-a002-77cb6e4a2e51'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:03.355305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] The token cache is being invalidate because project 973160cd8f914d3eab1b0c1f1d4609c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:38:03.355600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:03.356241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:03.357773 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1389/2760] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:38:03 2022] DELETE /identity/v3/projects/973160cd8f914d3eab1b0c1f1d4609c4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:23.920564 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68b5c-2bb0-4735-90bb-5c670c98e9d3 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:23.921987 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a8e68b5c-2bb0-4735-90bb-5c670c98e9d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:24.004914 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68b5c-2bb0-4735-90bb-5c670c98e9d3 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:24.073497 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:24.074275 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:24.075162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:24.075162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:24.077190 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:24.090312 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:24.092032 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:24.103762 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1372/2761] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:27.220665 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:27.222057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:27.310316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a573f-55bb-469f-a002-77cb6e4a2e51 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:27.315824 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35ae873d42b490cae4dd610f2ac6a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:27.316472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:27.316814 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:27.317047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:27.318796 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:27.330989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:27.332554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:27.342715 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1390/2762] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:34.058847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:34.060232 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:34.114009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0055a-03ad-4e97-9422-22ec5ba9fbc5 service nova] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:34.118223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:34.118902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:34.119182 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:34.119459 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:34.121213 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:34.181334 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:34.182726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:34.191949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1373/2763] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:36.552127 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:36.553586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:36.565565 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe56f0-222c-42b1-893e-c3d04e2efd90 service placement] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:36.569134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c025bd-aecd-4353-9a81-162c6e043fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:36.569745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c025bd-aecd-4353-9a81-162c6e043fdf service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:36.570055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c025bd-aecd-4353-9a81-162c6e043fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:36.570365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c025bd-aecd-4353-9a81-162c6e043fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:36.572055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c5c025bd-aecd-4353-9a81-162c6e043fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:36.584698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c025bd-aecd-4353-9a81-162c6e043fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:36.586133 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c025bd-aecd-4353-9a81-162c6e043fdf service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:36.596101 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1391/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:37.686902 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:37.688481 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:37.700717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ab6ed-1e94-4f2e-b4e6-3961db9ff8da service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:37.705303 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:37.706192 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:37.706473 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:37.706744 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] PATH_INFO: `/v3/users/d791b80cee0d494c9a307e6293f68679` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:37.720905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d791b80cee0d494c9a307e6293f68679)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:37.722945 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:37.772587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd791b80cee0d494c9a307e6293f68679'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:37.780233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd791b80cee0d494c9a307e6293f68679'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:37.780885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd791b80cee0d494c9a307e6293f68679'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:37.787822 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd791b80cee0d494c9a307e6293f68679'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:37.799601 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-3764958e-5e8d-43b1-b45a-4c78ce20fc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd791b80cee0d494c9a307e6293f68679'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:37.805505 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1374/2765] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:38:37 2022] DELETE /identity/v3/users/d791b80cee0d494c9a307e6293f68679 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:37.999316 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c025bd-aecd-4353-9a81-162c6e043fdf service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:38.013719 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c025bd-aecd-4353-9a81-162c6e043fdf service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:38.071606 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:38.072391 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.073261 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.073540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] PATH_INFO: `/v3/projects/44e141ba2afe439c88dacb1c3939d477` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.083751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e141ba2afe439c88dacb1c3939d477)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:38.085686 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:38.131032 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e141ba2afe439c88dacb1c3939d477', 'request_id': 'req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:38.138661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e141ba2afe439c88dacb1c3939d477', 'request_id': 'req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:38.146224 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e141ba2afe439c88dacb1c3939d477', 'request_id': 'req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:38.157594 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] The token cache is being invalidate because project 44e141ba2afe439c88dacb1c3939d477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:38:38.157883 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:38.158563 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-04cf1d0c-4aea-4db4-8433-5b9d7b0f965f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:38.160100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1392/2766] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:38:37 2022] DELETE /identity/v3/projects/44e141ba2afe439c88dacb1c3939d477 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:38.165008 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fed94-51ed-403f-be01-9b592cc90b69 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.165299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fed94-51ed-403f-be01-9b592cc90b69 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.165579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fed94-51ed-403f-be01-9b592cc90b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.184522 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-916fed94-51ed-403f-be01-9b592cc90b69 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:38.185713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-916fed94-51ed-403f-be01-9b592cc90b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:38.243445 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1375/2767] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:38:38.252279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c3ec-4c34-4034-bff1-c8ab34523976 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.252566 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c3ec-4c34-4034-bff1-c8ab34523976 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.252845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c3ec-4c34-4034-bff1-c8ab34523976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.270469 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-46c4c3ec-4c34-4034-bff1-c8ab34523976 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:38.271921 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-46c4c3ec-4c34-4034-bff1-c8ab34523976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:38.279996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1393/2768] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:38.284215 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fed94-51ed-403f-be01-9b592cc90b69 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:38.294325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fed94-51ed-403f-be01-9b592cc90b69 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:38.298970 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aace11f-0c9f-4d75-97b0-25b14a99d361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:38.299621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aace11f-0c9f-4d75-97b0-25b14a99d361 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.299903 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aace11f-0c9f-4d75-97b0-25b14a99d361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.300199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aace11f-0c9f-4d75-97b0-25b14a99d361 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.300975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aace11f-0c9f-4d75-97b0-25b14a99d361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:38:38.301278 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aace11f-0c9f-4d75-97b0-25b14a99d361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:38.303050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aace11f-0c9f-4d75-97b0-25b14a99d361 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:38.315544 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1376/2769] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:38:38.319923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c3ec-4c34-4034-bff1-c8ab34523976 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:38.329212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c3ec-4c34-4034-bff1-c8ab34523976 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:38.338208 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca7598-5fb6-4258-b858-a0295ea91918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:38.339140 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca7598-5fb6-4258-b858-a0295ea91918 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.339626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca7598-5fb6-4258-b858-a0295ea91918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.340029 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca7598-5fb6-4258-b858-a0295ea91918 admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.340802 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca7598-5fb6-4258-b858-a0295ea91918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:38.342870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca7598-5fb6-4258-b858-a0295ea91918 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:38.380382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1394/2770] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:38:38 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:38:38.384692 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aace11f-0c9f-4d75-97b0-25b14a99d361 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:38.394931 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aace11f-0c9f-4d75-97b0-25b14a99d361 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:38.455001 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2edcdc-5218-4d15-b07c-25bccf39f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:38.455686 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2edcdc-5218-4d15-b07c-25bccf39f6ec admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.455957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2edcdc-5218-4d15-b07c-25bccf39f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.456234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2edcdc-5218-4d15-b07c-25bccf39f6ec admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.456929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2edcdc-5218-4d15-b07c-25bccf39f6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:38.458922 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2edcdc-5218-4d15-b07c-25bccf39f6ec admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:38.482391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1377/2771] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:38:38 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:38:38.483585 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca7598-5fb6-4258-b858-a0295ea91918 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:38.495929 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca7598-5fb6-4258-b858-a0295ea91918 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:38.500825 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22859e-000a-4544-aa32-4667445195dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:38.501569 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22859e-000a-4544-aa32-4667445195dc admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.501935 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22859e-000a-4544-aa32-4667445195dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.502334 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22859e-000a-4544-aa32-4667445195dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.503134 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22859e-000a-4544-aa32-4667445195dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:38.504803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22859e-000a-4544-aa32-4667445195dc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:38.516223 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1395/2772] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:38:38.520286 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2edcdc-5218-4d15-b07c-25bccf39f6ec admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:38.531452 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2edcdc-5218-4d15-b07c-25bccf39f6ec admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:38.536845 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9bc4b-290d-495d-ac07-5ac35dd6bbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:38.537504 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bc4b-290d-495d-ac07-5ac35dd6bbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.537788 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bc4b-290d-495d-ac07-5ac35dd6bbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.538064 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bc4b-290d-495d-ac07-5ac35dd6bbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.538841 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9bc4b-290d-495d-ac07-5ac35dd6bbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:38.540418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9bc4b-290d-495d-ac07-5ac35dd6bbc0 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:38.551435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1378/2773] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:38:38.555483 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22859e-000a-4544-aa32-4667445195dc admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:38.566287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22859e-000a-4544-aa32-4667445195dc admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:38.571807 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c21b3-c998-4372-88b9-5f713dc02c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:38.572627 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c21b3-c998-4372-88b9-5f713dc02c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.573366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c21b3-c998-4372-88b9-5f713dc02c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.573845 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c21b3-c998-4372-88b9-5f713dc02c81 admin admin] PATH_INFO: `/v3/projects/06a24a17a6ac4ecf8e237433c3c78a42/users/19f0b8b4176b4d4e961e9f90b3241e33/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.591219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c21b3-c998-4372-88b9-5f713dc02c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a24a17a6ac4ecf8e237433c3c78a42, user_id=19f0b8b4176b4d4e961e9f90b3241e33, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:38.593851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c21b3-c998-4372-88b9-5f713dc02c81 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:38.608552 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1396/2774] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:38:38 2022] PUT /identity/v3/projects/06a24a17a6ac4ecf8e237433c3c78a42/users/19f0b8b4176b4d4e961e9f90b3241e33/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:38.618971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29b27-6720-48cc-9a87-c775bb8339d8 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.619299 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29b27-6720-48cc-9a87-c775bb8339d8 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.619569 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29b27-6720-48cc-9a87-c775bb8339d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.649734 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-a2b29b27-6720-48cc-9a87-c775bb8339d8 None None] MFA Rules not processed for user `19f0b8b4176b4d4e961e9f90b3241e33`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:38.651510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a2b29b27-6720-48cc-9a87-c775bb8339d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:38.722254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1379/2775] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:38.732861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c21b3-c998-4372-88b9-5f713dc02c81 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:38.734870 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b34c21b3-c998-4372-88b9-5f713dc02c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:38.811106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c21b3-c998-4372-88b9-5f713dc02c81 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:38.816599 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167097c6-b7f1-4fff-adc3-8ba15ba94c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a64b4a57114f77a231a31e16b3923e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:38.817244 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167097c6-b7f1-4fff-adc3-8ba15ba94c2d service nova] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:38.817524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167097c6-b7f1-4fff-adc3-8ba15ba94c2d service nova] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:38.817850 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167097c6-b7f1-4fff-adc3-8ba15ba94c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:38.826517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167097c6-b7f1-4fff-adc3-8ba15ba94c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:38.828120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167097c6-b7f1-4fff-adc3-8ba15ba94c2d service nova] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:38.837593 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1397/2776] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:43.180062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29b27-6720-48cc-9a87-c775bb8339d8 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:43.182516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-a2b29b27-6720-48cc-9a87-c775bb8339d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:43.247782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29b27-6720-48cc-9a87-c775bb8339d8 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:43.252230 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:43.253083 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:43.253362 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:43.253640 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] PATH_INFO: `/v3/users/78bb6c03eb73430d9d208839a8fecf52` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:43.254828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78bb6c03eb73430d9d208839a8fecf52)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:43.256739 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:43.300306 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78bb6c03eb73430d9d208839a8fecf52'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.310396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78bb6c03eb73430d9d208839a8fecf52'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.310997 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78bb6c03eb73430d9d208839a8fecf52'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.317905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78bb6c03eb73430d9d208839a8fecf52'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.329830 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78bb6c03eb73430d9d208839a8fecf52'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.335603 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1380/2777] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:38:43 2022] DELETE /identity/v3/users/78bb6c03eb73430d9d208839a8fecf52 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:43.501513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167097c6-b7f1-4fff-adc3-8ba15ba94c2d service nova] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:43.512057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167097c6-b7f1-4fff-adc3-8ba15ba94c2d service nova] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:43.568445 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:43.569310 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:43.569592 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:43.569869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] PATH_INFO: `/v3/projects/f4dba5966a74456cb57fc9ad46e00bfe` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:43.571091 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4dba5966a74456cb57fc9ad46e00bfe)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:43.573050 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:43.617440 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4dba5966a74456cb57fc9ad46e00bfe', 'request_id': 'req-34744a1a-fbe3-4e88-8d37-02684fe11e60'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.624751 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4dba5966a74456cb57fc9ad46e00bfe', 'request_id': 'req-34744a1a-fbe3-4e88-8d37-02684fe11e60'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.630645 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4dba5966a74456cb57fc9ad46e00bfe', 'request_id': 'req-34744a1a-fbe3-4e88-8d37-02684fe11e60'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.640588 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] The token cache is being invalidate because project f4dba5966a74456cb57fc9ad46e00bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:38:43.640887 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.641527 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.643193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1398/2778] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:38:43 2022] DELETE /identity/v3/projects/f4dba5966a74456cb57fc9ad46e00bfe => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:43.647475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:43.648858 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:43.662009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48abe0-229f-47d1-98f1-d40c034b1d50 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:43.717793 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:43.718661 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:43.718943 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:43.719215 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] PATH_INFO: `/v3/users/597d891898a44b7b8c1cc426ba42ee3a` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:43.720391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=597d891898a44b7b8c1cc426ba42ee3a)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:43.722327 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:43.764589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597d891898a44b7b8c1cc426ba42ee3a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.771298 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597d891898a44b7b8c1cc426ba42ee3a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.772215 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597d891898a44b7b8c1cc426ba42ee3a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.779246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597d891898a44b7b8c1cc426ba42ee3a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.790601 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597d891898a44b7b8c1cc426ba42ee3a'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:43.796838 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1381/2779] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:38:43 2022] DELETE /identity/v3/users/597d891898a44b7b8c1cc426ba42ee3a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:43.966302 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:43.967945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:43.981313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744a1a-fbe3-4e88-8d37-02684fe11e60 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:44.036117 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:44.036991 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:44.037279 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:44.037560 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] PATH_INFO: `/v3/projects/4cf861ead6d04331934a91210b174459` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:44.038760 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf861ead6d04331934a91210b174459)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:44.040658 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:44.083971 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf861ead6d04331934a91210b174459', 'request_id': 'req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:44.091259 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf861ead6d04331934a91210b174459', 'request_id': 'req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:44.097219 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf861ead6d04331934a91210b174459', 'request_id': 'req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:44.107633 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] The token cache is being invalidate because project 4cf861ead6d04331934a91210b174459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:38:44.107917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:44.108536 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-5b0c7b50-b2f2-4261-b5c1-fbf37ca54ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:44.110035 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1399/2780] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:38:43 2022] DELETE /identity/v3/projects/4cf861ead6d04331934a91210b174459 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:47.124647 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:47.126041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:47.139600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d720c-6b68-4015-8e22-2eb478537317 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:47.192173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:47.193034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:47.193315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:47.193588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] PATH_INFO: `/v3/users/19f0b8b4176b4d4e961e9f90b3241e33` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:47.194751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f0b8b4176b4d4e961e9f90b3241e33)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:47.196646 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:47.240587 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f0b8b4176b4d4e961e9f90b3241e33'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.247850 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f0b8b4176b4d4e961e9f90b3241e33'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.248468 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f0b8b4176b4d4e961e9f90b3241e33'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.255039 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f0b8b4176b4d4e961e9f90b3241e33'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.266162 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f0b8b4176b4d4e961e9f90b3241e33'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.272009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1382/2781] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:38:47 2022] DELETE /identity/v3/users/19f0b8b4176b4d4e961e9f90b3241e33 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:47.276425 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0f9f-1414-4325-93b0-c89d25641af9 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:47.276913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0f9f-1414-4325-93b0-c89d25641af9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:47.277020 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0f9f-1414-4325-93b0-c89d25641af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:47.294451 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c4de0f9f-1414-4325-93b0-c89d25641af9 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:47.295639 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c4de0f9f-1414-4325-93b0-c89d25641af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:47.351552 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1400/2782] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:47.361626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:47.363035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:47.417582 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd44f5-3828-4faa-b368-0198b377e5d8 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:47.421295 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38cd39-71cc-4cea-9851-c0c01487d0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:47.421929 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38cd39-71cc-4cea-9851-c0c01487d0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:47.422247 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38cd39-71cc-4cea-9851-c0c01487d0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:47.422528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38cd39-71cc-4cea-9851-c0c01487d0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:47.431332 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38cd39-71cc-4cea-9851-c0c01487d0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:47.433365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38cd39-71cc-4cea-9851-c0c01487d0e1 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:47.442651 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1383/2783] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:47.691815 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de0f9f-1414-4325-93b0-c89d25641af9 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:47.693234 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c4de0f9f-1414-4325-93b0-c89d25641af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:47.704930 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de0f9f-1414-4325-93b0-c89d25641af9 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:47.709520 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:47.710406 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:47.710692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:47.710969 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] PATH_INFO: `/v3/projects/06a24a17a6ac4ecf8e237433c3c78a42` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:47.712160 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a24a17a6ac4ecf8e237433c3c78a42)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:47.714651 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:47.760142 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a24a17a6ac4ecf8e237433c3c78a42', 'request_id': 'req-1f36e480-af55-4080-821e-7e539419c06e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.767018 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a24a17a6ac4ecf8e237433c3c78a42', 'request_id': 'req-1f36e480-af55-4080-821e-7e539419c06e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.773444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a24a17a6ac4ecf8e237433c3c78a42', 'request_id': 'req-1f36e480-af55-4080-821e-7e539419c06e'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.783725 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] The token cache is being invalidate because project 06a24a17a6ac4ecf8e237433c3c78a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79406) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:38:47.783953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.784561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-1f36e480-af55-4080-821e-7e539419c06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:47.786071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1401/2784] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:38:47 2022] DELETE /identity/v3/projects/06a24a17a6ac4ecf8e237433c3c78a42 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:47.791050 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3512de6-f1ab-42d5-8d2d-d8425c684c57 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:47.791343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3512de6-f1ab-42d5-8d2d-d8425c684c57 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:47.792284 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3512de6-f1ab-42d5-8d2d-d8425c684c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:47.809635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-f3512de6-f1ab-42d5-8d2d-d8425c684c57 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:47.810861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-f3512de6-f1ab-42d5-8d2d-d8425c684c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:47.866598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1384/2785] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:47.874371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e64f-cda1-4a68-8e7d-acb4c2bf41cd None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:47.874661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e64f-cda1-4a68-8e7d-acb4c2bf41cd None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:47.874940 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e64f-cda1-4a68-8e7d-acb4c2bf41cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:47.893545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-31f0e64f-cda1-4a68-8e7d-acb4c2bf41cd None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:47.894759 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-31f0e64f-cda1-4a68-8e7d-acb4c2bf41cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:47.903291 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1402/2786] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:47.907338 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3512de6-f1ab-42d5-8d2d-d8425c684c57 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:47.917238 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3512de6-f1ab-42d5-8d2d-d8425c684c57 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:47.921870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde62b07-d0a7-42ac-b9bd-fd2ab71e6253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:47.922556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde62b07-d0a7-42ac-b9bd-fd2ab71e6253 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:47.922846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde62b07-d0a7-42ac-b9bd-fd2ab71e6253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:47.923126 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde62b07-d0a7-42ac-b9bd-fd2ab71e6253 admin admin] PATH_INFO: `/v3/domains` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:47.923847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde62b07-d0a7-42ac-b9bd-fd2ab71e6253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:38:47.924161 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde62b07-d0a7-42ac-b9bd-fd2ab71e6253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:47.925749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde62b07-d0a7-42ac-b9bd-fd2ab71e6253 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:47.936768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1385/2787] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:38:47.940948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0e64f-cda1-4a68-8e7d-acb4c2bf41cd None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:47.949885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0e64f-cda1-4a68-8e7d-acb4c2bf41cd None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:47.954915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc82d-5162-45c4-84da-7324378db05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:47.955622 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc82d-5162-45c4-84da-7324378db05a admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:47.956083 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc82d-5162-45c4-84da-7324378db05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:47.956444 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc82d-5162-45c4-84da-7324378db05a admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:47.957485 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cc82d-5162-45c4-84da-7324378db05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:47.959963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cc82d-5162-45c4-84da-7324378db05a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:47.984966 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1403/2788] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:38:47 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:38:47.988995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde62b07-d0a7-42ac-b9bd-fd2ab71e6253 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:47.998595 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde62b07-d0a7-42ac-b9bd-fd2ab71e6253 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.051145 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fe7af-528a-4083-b70b-eec8b8351e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.051726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe7af-528a-4083-b70b-eec8b8351e13 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.052009 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe7af-528a-4083-b70b-eec8b8351e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.052285 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe7af-528a-4083-b70b-eec8b8351e13 admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.052947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fe7af-528a-4083-b70b-eec8b8351e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.054869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fe7af-528a-4083-b70b-eec8b8351e13 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.073779 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1386/2789] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:38:47 2022] POST /identity/v3/users => generated 303 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:38:48.077816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc82d-5162-45c4-84da-7324378db05a admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.087733 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc82d-5162-45c4-84da-7324378db05a admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.092886 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccf3fc-e7f6-463c-ac7e-00c4eaa3c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.093535 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccf3fc-e7f6-463c-ac7e-00c4eaa3c784 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.093823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccf3fc-e7f6-463c-ac7e-00c4eaa3c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.094124 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccf3fc-e7f6-463c-ac7e-00c4eaa3c784 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.094848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccf3fc-e7f6-463c-ac7e-00c4eaa3c784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.096428 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccf3fc-e7f6-463c-ac7e-00c4eaa3c784 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.106742 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1404/2790] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:38:48.110365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fe7af-528a-4083-b70b-eec8b8351e13 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.119847 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fe7af-528a-4083-b70b-eec8b8351e13 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.124328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a543-274d-4a07-b4db-4860f8529f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.124961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a543-274d-4a07-b4db-4860f8529f47 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.125534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a543-274d-4a07-b4db-4860f8529f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.125534 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a543-274d-4a07-b4db-4860f8529f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.126226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a543-274d-4a07-b4db-4860f8529f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.127805 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a543-274d-4a07-b4db-4860f8529f47 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.137900 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1387/2791] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:38:48.141771 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccf3fc-e7f6-463c-ac7e-00c4eaa3c784 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.152273 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccf3fc-e7f6-463c-ac7e-00c4eaa3c784 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.156789 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d78f3-78a8-4191-af6e-d30d276bfb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.157650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d78f3-78a8-4191-af6e-d30d276bfb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.157933 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d78f3-78a8-4191-af6e-d30d276bfb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.158247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d78f3-78a8-4191-af6e-d30d276bfb7b admin admin] PATH_INFO: `/v3/projects/9b0bb9d1d69940bb8083f6436e7093c7/users/7562f5c8dab44b41a1ce7098ea07a7f6/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.172241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d78f3-78a8-4191-af6e-d30d276bfb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0bb9d1d69940bb8083f6436e7093c7, user_id=7562f5c8dab44b41a1ce7098ea07a7f6, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.174874 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d78f3-78a8-4191-af6e-d30d276bfb7b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.187439 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1405/2792] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:38:48 2022] PUT /identity/v3/projects/9b0bb9d1d69940bb8083f6436e7093c7/users/7562f5c8dab44b41a1ce7098ea07a7f6/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:48.199066 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce80658-0f51-415c-89c6-5cff95b25f83 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.199354 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce80658-0f51-415c-89c6-5cff95b25f83 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.199632 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce80658-0f51-415c-89c6-5cff95b25f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.225314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-6ce80658-0f51-415c-89c6-5cff95b25f83 None None] MFA Rules not processed for user `7562f5c8dab44b41a1ce7098ea07a7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:48.226539 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-6ce80658-0f51-415c-89c6-5cff95b25f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:48.288621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1388/2793] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:48.292882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d78f3-78a8-4191-af6e-d30d276bfb7b admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.351457 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d78f3-78a8-4191-af6e-d30d276bfb7b admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.356106 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c1aae-95ae-437b-8674-826a1ce220fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.356790 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c1aae-95ae-437b-8674-826a1ce220fd admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.357077 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c1aae-95ae-437b-8674-826a1ce220fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.357359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c1aae-95ae-437b-8674-826a1ce220fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.358055 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c1aae-95ae-437b-8674-826a1ce220fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.360058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c1aae-95ae-437b-8674-826a1ce220fd admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.386946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1406/2794] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:38:48 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:38:48.390972 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce80658-0f51-415c-89c6-5cff95b25f83 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.401766 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce80658-0f51-415c-89c6-5cff95b25f83 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.455092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ebf4-79d0-4a31-aa8c-314e7fbe295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.455753 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ebf4-79d0-4a31-aa8c-314e7fbe295c admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.456041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ebf4-79d0-4a31-aa8c-314e7fbe295c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.456321 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ebf4-79d0-4a31-aa8c-314e7fbe295c admin admin] PATH_INFO: `/v3/users` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.456996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ebf4-79d0-4a31-aa8c-314e7fbe295c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.458950 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ebf4-79d0-4a31-aa8c-314e7fbe295c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.477154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1389/2795] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:38:48 2022] POST /identity/v3/users => generated 309 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:38:48.481052 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c1aae-95ae-437b-8674-826a1ce220fd admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.491297 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c1aae-95ae-437b-8674-826a1ce220fd admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.496402 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d805b8-2f54-4cbe-8f4b-8dab2705b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.497054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d805b8-2f54-4cbe-8f4b-8dab2705b71a admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.497333 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d805b8-2f54-4cbe-8f4b-8dab2705b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.497605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d805b8-2f54-4cbe-8f4b-8dab2705b71a admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.498339 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d805b8-2f54-4cbe-8f4b-8dab2705b71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.499909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d805b8-2f54-4cbe-8f4b-8dab2705b71a admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.510004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1407/2796] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:38:48.514545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ebf4-79d0-4a31-aa8c-314e7fbe295c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.524919 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ebf4-79d0-4a31-aa8c-314e7fbe295c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.529635 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d66292-18bf-4e74-bb29-6033f93d8506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.530538 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66292-18bf-4e74-bb29-6033f93d8506 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.530824 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66292-18bf-4e74-bb29-6033f93d8506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.531100 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66292-18bf-4e74-bb29-6033f93d8506 admin admin] PATH_INFO: `/v3/projects/3599742dcdbc4b109a605aae83f9592a/users/7ac377c3ee5e4549a7a3569c3cb7ffdd/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.545169 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d66292-18bf-4e74-bb29-6033f93d8506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3599742dcdbc4b109a605aae83f9592a, user_id=7ac377c3ee5e4549a7a3569c3cb7ffdd, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.547839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d66292-18bf-4e74-bb29-6033f93d8506 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.561248 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1390/2797] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:38:48 2022] PUT /identity/v3/projects/3599742dcdbc4b109a605aae83f9592a/users/7ac377c3ee5e4549a7a3569c3cb7ffdd/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:48.565034 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d805b8-2f54-4cbe-8f4b-8dab2705b71a admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.575318 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d805b8-2f54-4cbe-8f4b-8dab2705b71a admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.628289 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65208df-0d17-48cc-b710-e0fab131b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.628948 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65208df-0d17-48cc-b710-e0fab131b1df admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.629236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65208df-0d17-48cc-b710-e0fab131b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.629513 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65208df-0d17-48cc-b710-e0fab131b1df admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.630253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65208df-0d17-48cc-b710-e0fab131b1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.631851 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65208df-0d17-48cc-b710-e0fab131b1df admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.641903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1408/2798] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:38:48.645911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d66292-18bf-4e74-bb29-6033f93d8506 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.656045 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d66292-18bf-4e74-bb29-6033f93d8506 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.660559 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fa8b0-0a25-46f6-b968-f4322957edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.661422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fa8b0-0a25-46f6-b968-f4322957edb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.661702 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fa8b0-0a25-46f6-b968-f4322957edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.661973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fa8b0-0a25-46f6-b968-f4322957edb0 admin admin] PATH_INFO: `/v3/projects/3599742dcdbc4b109a605aae83f9592a/users/7ac377c3ee5e4549a7a3569c3cb7ffdd/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.663938 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fa8b0-0a25-46f6-b968-f4322957edb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3599742dcdbc4b109a605aae83f9592a, user_id=7ac377c3ee5e4549a7a3569c3cb7ffdd, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.666579 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fa8b0-0a25-46f6-b968-f4322957edb0 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.676223 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1391/2799] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:38:48 2022] PUT /identity/v3/projects/3599742dcdbc4b109a605aae83f9592a/users/7ac377c3ee5e4549a7a3569c3cb7ffdd/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:48.686226 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3712d-8fbf-44f2-85a2-1bee456631e8 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.686524 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3712d-8fbf-44f2-85a2-1bee456631e8 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.686808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3712d-8fbf-44f2-85a2-1bee456631e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.712411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-76b3712d-8fbf-44f2-85a2-1bee456631e8 None None] MFA Rules not processed for user `7ac377c3ee5e4549a7a3569c3cb7ffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:48.713600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-76b3712d-8fbf-44f2-85a2-1bee456631e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:48.781623 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1409/2800] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:48.792776 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fa8b0-0a25-46f6-b968-f4322957edb0 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:48.794502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-954fa8b0-0a25-46f6-b968-f4322957edb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:48.871942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fa8b0-0a25-46f6-b968-f4322957edb0 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:48.875573 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bea83-5d69-41ba-95ce-516fb1fb0615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:48.876206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bea83-5d69-41ba-95ce-516fb1fb0615 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:48.876483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bea83-5d69-41ba-95ce-516fb1fb0615 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:48.876752 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bea83-5d69-41ba-95ce-516fb1fb0615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:48.885471 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bea83-5d69-41ba-95ce-516fb1fb0615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:48.887002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bea83-5d69-41ba-95ce-516fb1fb0615 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:48.896004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1392/2801] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:49.039472 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3712d-8fbf-44f2-85a2-1bee456631e8 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:49.099016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3712d-8fbf-44f2-85a2-1bee456631e8 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:49.103688 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:49.105195 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:49.105499 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:49.105775 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] PATH_INFO: `/v3/users/7562f5c8dab44b41a1ce7098ea07a7f6` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:49.106989 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7562f5c8dab44b41a1ce7098ea07a7f6)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:49.108944 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:49.153538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7562f5c8dab44b41a1ce7098ea07a7f6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.160196 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7562f5c8dab44b41a1ce7098ea07a7f6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.169518 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7562f5c8dab44b41a1ce7098ea07a7f6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.170170 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7562f5c8dab44b41a1ce7098ea07a7f6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.170864 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7562f5c8dab44b41a1ce7098ea07a7f6'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.188599 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1410/2802] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:38:49 2022] DELETE /identity/v3/users/7562f5c8dab44b41a1ce7098ea07a7f6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:49.193042 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31993e8-babe-42ad-87e2-d069f15b2b42 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:49.193502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31993e8-babe-42ad-87e2-d069f15b2b42 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:49.193637 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31993e8-babe-42ad-87e2-d069f15b2b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:49.210794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-e31993e8-babe-42ad-87e2-d069f15b2b42 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:49.211971 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e31993e8-babe-42ad-87e2-d069f15b2b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:49.267998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1393/2803] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:49.278192 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:49.279586 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:49.333885 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bd2ae-0f64-46d7-a38a-b7a47c53f10c admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:49.337494 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e8462-284f-48da-9380-2c662958dc23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:49.338152 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e8462-284f-48da-9380-2c662958dc23 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:49.338956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e8462-284f-48da-9380-2c662958dc23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:49.339235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e8462-284f-48da-9380-2c662958dc23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:49.347953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e8462-284f-48da-9380-2c662958dc23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:49.349365 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e8462-284f-48da-9380-2c662958dc23 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:49.359058 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1411/2804] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:49.609604 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31993e8-babe-42ad-87e2-d069f15b2b42 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:49.611013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e31993e8-babe-42ad-87e2-d069f15b2b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:49.626302 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31993e8-babe-42ad-87e2-d069f15b2b42 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:49.631123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:49.632403 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:49.632685 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:49.632957 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] PATH_INFO: `/v3/projects/9b0bb9d1d69940bb8083f6436e7093c7` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:49.634189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0bb9d1d69940bb8083f6436e7093c7)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:49.636197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:49.681993 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0bb9d1d69940bb8083f6436e7093c7', 'request_id': 'req-9bd81500-4283-4786-87b8-da96aa59da80'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.688515 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0bb9d1d69940bb8083f6436e7093c7', 'request_id': 'req-9bd81500-4283-4786-87b8-da96aa59da80'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.695472 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0bb9d1d69940bb8083f6436e7093c7', 'request_id': 'req-9bd81500-4283-4786-87b8-da96aa59da80'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.705147 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] The token cache is being invalidate because project 9b0bb9d1d69940bb8083f6436e7093c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:38:49.705435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.706049 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.707582 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1394/2805] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:38:49 2022] DELETE /identity/v3/projects/9b0bb9d1d69940bb8083f6436e7093c7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:49.711550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e8462-284f-48da-9380-2c662958dc23 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:49.720915 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e8462-284f-48da-9380-2c662958dc23 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:49.775329 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:49.776236 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:49.776543 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:49.776835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] PATH_INFO: `/v3/users/7ac377c3ee5e4549a7a3569c3cb7ffdd` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:49.778043 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac377c3ee5e4549a7a3569c3cb7ffdd)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:49.779982 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:49.825070 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac377c3ee5e4549a7a3569c3cb7ffdd'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.831836 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac377c3ee5e4549a7a3569c3cb7ffdd'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.839235 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac377c3ee5e4549a7a3569c3cb7ffdd'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.839861 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac377c3ee5e4549a7a3569c3cb7ffdd'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.840461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-74cb2342-d96e-4ea9-a8d4-6aef4ad86a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac377c3ee5e4549a7a3569c3cb7ffdd'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:49.857200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1412/2806] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:38:49 2022] DELETE /identity/v3/users/7ac377c3ee5e4549a7a3569c3cb7ffdd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:50.125669 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.127422 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:50.140499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd81500-4283-4786-87b8-da96aa59da80 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.194792 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.195650 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.195928 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.196199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] PATH_INFO: `/v3/projects/3599742dcdbc4b109a605aae83f9592a` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.197349 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3599742dcdbc4b109a605aae83f9592a)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.199287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:50.242894 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3599742dcdbc4b109a605aae83f9592a', 'request_id': 'req-4873fa21-cf95-42d9-aca2-293680ac2c73'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:50.248663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3599742dcdbc4b109a605aae83f9592a', 'request_id': 'req-4873fa21-cf95-42d9-aca2-293680ac2c73'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:50.255456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3599742dcdbc4b109a605aae83f9592a', 'request_id': 'req-4873fa21-cf95-42d9-aca2-293680ac2c73'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:50.265626 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] The token cache is being invalidate because project 3599742dcdbc4b109a605aae83f9592a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:38:50.265910 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:50.266602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4873fa21-cf95-42d9-aca2-293680ac2c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:50.268217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1395/2807] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:38:50 2022] DELETE /identity/v3/projects/3599742dcdbc4b109a605aae83f9592a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:50.273596 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80bf58-ed42-4fbb-9200-2df2e3d9fc2a None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.273882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80bf58-ed42-4fbb-9200-2df2e3d9fc2a None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.274193 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80bf58-ed42-4fbb-9200-2df2e3d9fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.292624 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-ab80bf58-ed42-4fbb-9200-2df2e3d9fc2a None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:50.293808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-ab80bf58-ed42-4fbb-9200-2df2e3d9fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:50.355680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1413/2808] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:38:50.364547 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cec63-4598-45fb-8b93-0f7eed762e9d None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.364836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cec63-4598-45fb-8b93-0f7eed762e9d None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.365112 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cec63-4598-45fb-8b93-0f7eed762e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.383023 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-352cec63-4598-45fb-8b93-0f7eed762e9d None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:50.384109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-352cec63-4598-45fb-8b93-0f7eed762e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:50.392337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1396/2809] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:50.396307 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80bf58-ed42-4fbb-9200-2df2e3d9fc2a None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.406521 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80bf58-ed42-4fbb-9200-2df2e3d9fc2a None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.411637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d913b-c961-47e9-bfdc-372efb6b0abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.412298 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d913b-c961-47e9-bfdc-372efb6b0abf admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.412827 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d913b-c961-47e9-bfdc-372efb6b0abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.413168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d913b-c961-47e9-bfdc-372efb6b0abf admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.414189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d913b-c961-47e9-bfdc-372efb6b0abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:38:50.414501 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d913b-c961-47e9-bfdc-372efb6b0abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.416317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d913b-c961-47e9-bfdc-372efb6b0abf admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:50.428175 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1414/2810] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:38:50.432731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cec63-4598-45fb-8b93-0f7eed762e9d None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.441905 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cec63-4598-45fb-8b93-0f7eed762e9d None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.446567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f4425-f327-44c2-a411-c14c9674e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.447208 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f4425-f327-44c2-a411-c14c9674e728 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.447493 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f4425-f327-44c2-a411-c14c9674e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.448280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f4425-f327-44c2-a411-c14c9674e728 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.448961 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f4425-f327-44c2-a411-c14c9674e728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.450885 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f4425-f327-44c2-a411-c14c9674e728 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:50.475160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1397/2811] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:38:50 2022] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:38:50.479188 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d913b-c961-47e9-bfdc-372efb6b0abf admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.488848 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d913b-c961-47e9-bfdc-372efb6b0abf admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.542412 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eb58c-f70e-4c95-a080-fe070e4287ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.543072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eb58c-f70e-4c95-a080-fe070e4287ea admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.543352 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eb58c-f70e-4c95-a080-fe070e4287ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.543626 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eb58c-f70e-4c95-a080-fe070e4287ea admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.544293 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992eb58c-f70e-4c95-a080-fe070e4287ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.546309 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992eb58c-f70e-4c95-a080-fe070e4287ea admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:50.565442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1415/2812] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:38:50 2022] POST /identity/v3/users => generated 303 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:38:50.569475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f4425-f327-44c2-a411-c14c9674e728 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.580027 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f4425-f327-44c2-a411-c14c9674e728 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.584699 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291e9db-09bc-451f-9cb9-ba4c7cfb86a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.585353 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e9db-09bc-451f-9cb9-ba4c7cfb86a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.585661 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e9db-09bc-451f-9cb9-ba4c7cfb86a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.585934 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e9db-09bc-451f-9cb9-ba4c7cfb86a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.586679 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291e9db-09bc-451f-9cb9-ba4c7cfb86a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.588253 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291e9db-09bc-451f-9cb9-ba4c7cfb86a7 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:50.599022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1398/2813] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:38:50.602869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eb58c-f70e-4c95-a080-fe070e4287ea admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.612481 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eb58c-f70e-4c95-a080-fe070e4287ea admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.617039 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e543e-a2c8-4b92-80c9-a67e4ca39bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.617676 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e543e-a2c8-4b92-80c9-a67e4ca39bef admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.617959 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e543e-a2c8-4b92-80c9-a67e4ca39bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.618270 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e543e-a2c8-4b92-80c9-a67e4ca39bef admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.618977 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e543e-a2c8-4b92-80c9-a67e4ca39bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.621061 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e543e-a2c8-4b92-80c9-a67e4ca39bef admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:50.631906 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1416/2814] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:38:50.636711 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291e9db-09bc-451f-9cb9-ba4c7cfb86a7 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.647065 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291e9db-09bc-451f-9cb9-ba4c7cfb86a7 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.651624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b907bc-ed1a-4718-a9e2-2e78f215582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.652500 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b907bc-ed1a-4718-a9e2-2e78f215582e admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.652785 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b907bc-ed1a-4718-a9e2-2e78f215582e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.653062 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b907bc-ed1a-4718-a9e2-2e78f215582e admin admin] PATH_INFO: `/v3/projects/bb6abd281dc04bc8bb07318edb1ada25/users/94953784d48d432d844bcc2b5ba80a36/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.667681 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b907bc-ed1a-4718-a9e2-2e78f215582e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6abd281dc04bc8bb07318edb1ada25, user_id=94953784d48d432d844bcc2b5ba80a36, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.670333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b907bc-ed1a-4718-a9e2-2e78f215582e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:50.683391 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1399/2815] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:38:50 2022] PUT /identity/v3/projects/bb6abd281dc04bc8bb07318edb1ada25/users/94953784d48d432d844bcc2b5ba80a36/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:50.693404 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d92411-2dfc-48be-bf3e-704e3f638400 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.693695 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d92411-2dfc-48be-bf3e-704e3f638400 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.693970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d92411-2dfc-48be-bf3e-704e3f638400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.720047 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-04d92411-2dfc-48be-bf3e-704e3f638400 None None] MFA Rules not processed for user `94953784d48d432d844bcc2b5ba80a36`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:50.721239 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-04d92411-2dfc-48be-bf3e-704e3f638400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:50.781625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1417/2816] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:50.786004 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b907bc-ed1a-4718-a9e2-2e78f215582e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.845411 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b907bc-ed1a-4718-a9e2-2e78f215582e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.850096 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d995a33-7c79-40a7-9daf-2d3f8427d634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.850773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d995a33-7c79-40a7-9daf-2d3f8427d634 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.851058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d995a33-7c79-40a7-9daf-2d3f8427d634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.851333 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d995a33-7c79-40a7-9daf-2d3f8427d634 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.852023 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d995a33-7c79-40a7-9daf-2d3f8427d634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.853906 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d995a33-7c79-40a7-9daf-2d3f8427d634 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:50.877933 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1400/2817] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:38:50 2022] POST /identity/v3/projects => generated 407 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:38:50.881942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d92411-2dfc-48be-bf3e-704e3f638400 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.892843 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d92411-2dfc-48be-bf3e-704e3f638400 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.945950 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79fdc-03f8-4d62-a4ee-7a7925e7ae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.946654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79fdc-03f8-4d62-a4ee-7a7925e7ae4d admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.946942 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79fdc-03f8-4d62-a4ee-7a7925e7ae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.947220 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79fdc-03f8-4d62-a4ee-7a7925e7ae4d admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.948491 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e79fdc-03f8-4d62-a4ee-7a7925e7ae4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.950471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e79fdc-03f8-4d62-a4ee-7a7925e7ae4d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:50.969241 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1418/2818] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:38:50 2022] POST /identity/v3/users => generated 310 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:38:50.973673 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d995a33-7c79-40a7-9daf-2d3f8427d634 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:50.984571 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d995a33-7c79-40a7-9daf-2d3f8427d634 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:50.989123 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084d499-3726-487a-98cd-6cbe00e26498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:50.989768 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084d499-3726-487a-98cd-6cbe00e26498 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:50.990047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084d499-3726-487a-98cd-6cbe00e26498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:50.990350 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084d499-3726-487a-98cd-6cbe00e26498 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:50.991058 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084d499-3726-487a-98cd-6cbe00e26498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:50.992638 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084d499-3726-487a-98cd-6cbe00e26498 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:51.003343 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1401/2819] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:38:51.007697 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79fdc-03f8-4d62-a4ee-7a7925e7ae4d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:51.017785 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79fdc-03f8-4d62-a4ee-7a7925e7ae4d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:51.022683 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5deabd-abe3-418d-8f1e-b64b5776ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:51.023553 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5deabd-abe3-418d-8f1e-b64b5776ef04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:51.023835 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5deabd-abe3-418d-8f1e-b64b5776ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:51.024107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5deabd-abe3-418d-8f1e-b64b5776ef04 admin admin] PATH_INFO: `/v3/projects/3673dfc19a1c40f9b42558a7f843165e/users/d0672be209c44c66896c496bb6bf7e7d/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:51.039120 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5deabd-abe3-418d-8f1e-b64b5776ef04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3673dfc19a1c40f9b42558a7f843165e, user_id=d0672be209c44c66896c496bb6bf7e7d, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:51.042073 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5deabd-abe3-418d-8f1e-b64b5776ef04 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:51.054382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1419/2820] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:38:51 2022] PUT /identity/v3/projects/3673dfc19a1c40f9b42558a7f843165e/users/d0672be209c44c66896c496bb6bf7e7d/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:38:51.058901 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084d499-3726-487a-98cd-6cbe00e26498 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:51.068782 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084d499-3726-487a-98cd-6cbe00e26498 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:51.122034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53627caf-9a11-46df-b84d-b0ea71cf7339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:51.122717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53627caf-9a11-46df-b84d-b0ea71cf7339 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:51.123002 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53627caf-9a11-46df-b84d-b0ea71cf7339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:51.123280 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53627caf-9a11-46df-b84d-b0ea71cf7339 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:51.123995 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53627caf-9a11-46df-b84d-b0ea71cf7339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:51.125570 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53627caf-9a11-46df-b84d-b0ea71cf7339 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:51.137506 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1402/2821] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:38:51.139004 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5deabd-abe3-418d-8f1e-b64b5776ef04 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:51.149410 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5deabd-abe3-418d-8f1e-b64b5776ef04 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:51.154203 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c74b3-646a-41b8-bc07-8a2c43dcdd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:51.155088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c74b3-646a-41b8-bc07-8a2c43dcdd02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:51.155372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c74b3-646a-41b8-bc07-8a2c43dcdd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:51.155650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c74b3-646a-41b8-bc07-8a2c43dcdd02 admin admin] PATH_INFO: `/v3/projects/3673dfc19a1c40f9b42558a7f843165e/users/d0672be209c44c66896c496bb6bf7e7d/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:51.157685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c74b3-646a-41b8-bc07-8a2c43dcdd02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3673dfc19a1c40f9b42558a7f843165e, user_id=d0672be209c44c66896c496bb6bf7e7d, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:51.160364 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c74b3-646a-41b8-bc07-8a2c43dcdd02 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:51.171137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1420/2822] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:38:51 2022] PUT /identity/v3/projects/3673dfc19a1c40f9b42558a7f843165e/users/d0672be209c44c66896c496bb6bf7e7d/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:38:51.180994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109c4c0-7557-48ee-af1b-2849f0401805 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:51.181281 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109c4c0-7557-48ee-af1b-2849f0401805 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:51.181556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109c4c0-7557-48ee-af1b-2849f0401805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:51.207133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b109c4c0-7557-48ee-af1b-2849f0401805 None None] MFA Rules not processed for user `d0672be209c44c66896c496bb6bf7e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:51.208328 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b109c4c0-7557-48ee-af1b-2849f0401805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:51.272199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1403/2823] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:51 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:38:51.282928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c74b3-646a-41b8-bc07-8a2c43dcdd02 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:51.284611 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-293c74b3-646a-41b8-bc07-8a2c43dcdd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:38:51.340946 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c74b3-646a-41b8-bc07-8a2c43dcdd02 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:51.344568 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166db1-0bf7-49b2-bdb2-3963a67ac1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:51.345211 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166db1-0bf7-49b2-bdb2-3963a67ac1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:51.345495 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166db1-0bf7-49b2-bdb2-3963a67ac1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:51.345770 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166db1-0bf7-49b2-bdb2-3963a67ac1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:51.355168 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73166db1-0bf7-49b2-bdb2-3963a67ac1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:51.356583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73166db1-0bf7-49b2-bdb2-3963a67ac1d1 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:51.365791 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1421/2824] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:51 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:51.502252 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109c4c0-7557-48ee-af1b-2849f0401805 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:51.511688 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109c4c0-7557-48ee-af1b-2849f0401805 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:51.515199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90533ac-21e0-498f-abe4-cf167af82789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:51.515828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90533ac-21e0-498f-abe4-cf167af82789 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:51.516111 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90533ac-21e0-498f-abe4-cf167af82789 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:51.516388 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90533ac-21e0-498f-abe4-cf167af82789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:51.570287 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90533ac-21e0-498f-abe4-cf167af82789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:51.571700 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90533ac-21e0-498f-abe4-cf167af82789 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:51.580326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1404/2825] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:38:51 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:38:59.805654 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166db1-0bf7-49b2-bdb2-3963a67ac1d1 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:38:59.865363 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166db1-0bf7-49b2-bdb2-3963a67ac1d1 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:38:59.869746 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:38:59.870675 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:59.870957 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:59.871230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] PATH_INFO: `/v3/users/94953784d48d432d844bcc2b5ba80a36` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:59.872385 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94953784d48d432d844bcc2b5ba80a36)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:38:59.874300 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:38:59.917956 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94953784d48d432d844bcc2b5ba80a36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:59.924386 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94953784d48d432d844bcc2b5ba80a36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:59.931393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94953784d48d432d844bcc2b5ba80a36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:59.932189 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94953784d48d432d844bcc2b5ba80a36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:59.932893 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94953784d48d432d844bcc2b5ba80a36'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:38:59.950174 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1422/2826] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:38:59 2022] DELETE /identity/v3/users/94953784d48d432d844bcc2b5ba80a36 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:38:59.954658 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef5f3-a81f-49fd-a157-866ecfbd72fd None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:38:59.955206 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef5f3-a81f-49fd-a157-866ecfbd72fd None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:38:59.955374 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef5f3-a81f-49fd-a157-866ecfbd72fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:38:59.973519 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-d30ef5f3-a81f-49fd-a157-866ecfbd72fd None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:38:59.974861 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d30ef5f3-a81f-49fd-a157-866ecfbd72fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:00.036985 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1405/2827] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:39:00.047092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:00.048625 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:00.102646 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01695cf-86d8-4dff-8ee5-42995caac33e admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:00.106779 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5b39-e7e3-4e61-a44e-257bf99ff5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:00.107415 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5b39-e7e3-4e61-a44e-257bf99ff5fc service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:00.107699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5b39-e7e3-4e61-a44e-257bf99ff5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:00.107976 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5b39-e7e3-4e61-a44e-257bf99ff5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:00.116630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae5b39-e7e3-4e61-a44e-257bf99ff5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:00.118060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae5b39-e7e3-4e61-a44e-257bf99ff5fc service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:00.127869 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1423/2828] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:00.378764 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef5f3-a81f-49fd-a157-866ecfbd72fd None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:00.380278 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-d30ef5f3-a81f-49fd-a157-866ecfbd72fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:00.392456 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef5f3-a81f-49fd-a157-866ecfbd72fd None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:00.397209 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:00.398063 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:00.398379 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:00.398639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] PATH_INFO: `/v3/projects/bb6abd281dc04bc8bb07318edb1ada25` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:00.399839 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6abd281dc04bc8bb07318edb1ada25)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:00.402316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:00.448555 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6abd281dc04bc8bb07318edb1ada25', 'request_id': 'req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.454487 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6abd281dc04bc8bb07318edb1ada25', 'request_id': 'req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.461462 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6abd281dc04bc8bb07318edb1ada25', 'request_id': 'req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.471694 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] The token cache is being invalidate because project bb6abd281dc04bc8bb07318edb1ada25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:39:00.471974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.472590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.474087 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1406/2829] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:39:00 2022] DELETE /identity/v3/projects/bb6abd281dc04bc8bb07318edb1ada25 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:00.477990 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5b39-e7e3-4e61-a44e-257bf99ff5fc service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:00.488045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5b39-e7e3-4e61-a44e-257bf99ff5fc service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:00.542855 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:00.543723 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:00.544008 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:00.544283 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] PATH_INFO: `/v3/users/d0672be209c44c66896c496bb6bf7e7d` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:00.545453 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0672be209c44c66896c496bb6bf7e7d)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:00.547426 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:00.591104 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0672be209c44c66896c496bb6bf7e7d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.597808 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0672be209c44c66896c496bb6bf7e7d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.605136 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0672be209c44c66896c496bb6bf7e7d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.605923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0672be209c44c66896c496bb6bf7e7d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.606554 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-7626ad53-d024-4593-b994-0e74fa79dcba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0672be209c44c66896c496bb6bf7e7d'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:00.622909 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1424/2830] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:39:00 2022] DELETE /identity/v3/users/d0672be209c44c66896c496bb6bf7e7d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:00.886549 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:00.887951 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:00.900973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856a38-80d9-4a4e-8a7f-271b1dc3dd7e admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:00.956041 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:00.957113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:00.957113 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:00.957365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] PATH_INFO: `/v3/projects/3673dfc19a1c40f9b42558a7f843165e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:00.958634 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3673dfc19a1c40f9b42558a7f843165e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:00.960518 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:01.005199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3673dfc19a1c40f9b42558a7f843165e', 'request_id': 'req-d7ef3d16-4970-4415-92e5-6a3a027a6c21'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:01.011484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3673dfc19a1c40f9b42558a7f843165e', 'request_id': 'req-d7ef3d16-4970-4415-92e5-6a3a027a6c21'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:01.018394 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3673dfc19a1c40f9b42558a7f843165e', 'request_id': 'req-d7ef3d16-4970-4415-92e5-6a3a027a6c21'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:01.028897 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] The token cache is being invalidate because project 3673dfc19a1c40f9b42558a7f843165e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:39:01.029176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:01.029787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-d7ef3d16-4970-4415-92e5-6a3a027a6c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:01.031305 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1407/2831] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:39:00 2022] DELETE /identity/v3/projects/3673dfc19a1c40f9b42558a7f843165e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:39:01.036145 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7072e-1567-4ed0-be8f-15f656c84b12 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.036604 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7072e-1567-4ed0-be8f-15f656c84b12 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.036717 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7072e-1567-4ed0-be8f-15f656c84b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.054538 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-61c7072e-1567-4ed0-be8f-15f656c84b12 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:01.055728 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-61c7072e-1567-4ed0-be8f-15f656c84b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:01.113901 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1425/2832] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:01.123265 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5136ce-eb26-4e35-bd01-acc85f87fa0e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.123553 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5136ce-eb26-4e35-bd01-acc85f87fa0e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.123828 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5136ce-eb26-4e35-bd01-acc85f87fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.143326 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-3e5136ce-eb26-4e35-bd01-acc85f87fa0e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:01.144494 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-3e5136ce-eb26-4e35-bd01-acc85f87fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:01.153010 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1408/2833] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:01.157105 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7072e-1567-4ed0-be8f-15f656c84b12 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:01.166812 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7072e-1567-4ed0-be8f-15f656c84b12 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:01.172023 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa30094-3eb0-4bcd-ba41-9370bc3add41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:01.172678 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa30094-3eb0-4bcd-ba41-9370bc3add41 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.172963 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa30094-3eb0-4bcd-ba41-9370bc3add41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.173240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa30094-3eb0-4bcd-ba41-9370bc3add41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.173960 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa30094-3eb0-4bcd-ba41-9370bc3add41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:39:01.174305 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa30094-3eb0-4bcd-ba41-9370bc3add41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:01.175899 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa30094-3eb0-4bcd-ba41-9370bc3add41 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:01.187084 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1426/2834] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:39:01.191541 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5136ce-eb26-4e35-bd01-acc85f87fa0e None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:01.200915 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5136ce-eb26-4e35-bd01-acc85f87fa0e None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:01.205642 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511895df-9de4-46e1-829a-e7c2e613f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:01.206337 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511895df-9de4-46e1-829a-e7c2e613f231 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.206621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511895df-9de4-46e1-829a-e7c2e613f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.206896 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511895df-9de4-46e1-829a-e7c2e613f231 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.207624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511895df-9de4-46e1-829a-e7c2e613f231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:01.209545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511895df-9de4-46e1-829a-e7c2e613f231 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:01.235435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1409/2835] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:39:01 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:39:01.239701 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa30094-3eb0-4bcd-ba41-9370bc3add41 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:01.249691 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa30094-3eb0-4bcd-ba41-9370bc3add41 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:01.303659 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf10c9-d4b3-4d41-95a2-ad7debda97bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:01.304257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf10c9-d4b3-4d41-95a2-ad7debda97bd admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.304541 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf10c9-d4b3-4d41-95a2-ad7debda97bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.304819 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf10c9-d4b3-4d41-95a2-ad7debda97bd admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.305510 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf10c9-d4b3-4d41-95a2-ad7debda97bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:01.307849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf10c9-d4b3-4d41-95a2-ad7debda97bd admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:01.326463 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1427/2836] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:39:01 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:39:01.330496 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511895df-9de4-46e1-829a-e7c2e613f231 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:01.341154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511895df-9de4-46e1-829a-e7c2e613f231 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:01.345719 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01796-13c5-4fe2-bb10-66ac1200d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:01.346408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01796-13c5-4fe2-bb10-66ac1200d96c admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.346690 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01796-13c5-4fe2-bb10-66ac1200d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.346969 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01796-13c5-4fe2-bb10-66ac1200d96c admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.347684 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b01796-13c5-4fe2-bb10-66ac1200d96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:01.349258 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b01796-13c5-4fe2-bb10-66ac1200d96c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:01.359738 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1410/2837] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:39:01.363559 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf10c9-d4b3-4d41-95a2-ad7debda97bd admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:01.373200 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf10c9-d4b3-4d41-95a2-ad7debda97bd admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:01.377699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18433033-b594-41f4-97c5-ddc95e29b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:01.378372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18433033-b594-41f4-97c5-ddc95e29b3fc admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.378656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18433033-b594-41f4-97c5-ddc95e29b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.378928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18433033-b594-41f4-97c5-ddc95e29b3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.379630 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18433033-b594-41f4-97c5-ddc95e29b3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:01.381183 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18433033-b594-41f4-97c5-ddc95e29b3fc admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:01.390618 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1428/2838] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:39:01.394556 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01796-13c5-4fe2-bb10-66ac1200d96c admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:01.404787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01796-13c5-4fe2-bb10-66ac1200d96c admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:01.409317 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a3cd0-7545-4058-ae09-64f8c3ca5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:01.410193 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a3cd0-7545-4058-ae09-64f8c3ca5596 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.410474 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a3cd0-7545-4058-ae09-64f8c3ca5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.410750 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a3cd0-7545-4058-ae09-64f8c3ca5596 admin admin] PATH_INFO: `/v3/projects/f7ffe6a9f5f245e89b4666050303d6dc/users/91f6a7ce1d074f4ca0286e31fd8386da/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.425085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a3cd0-7545-4058-ae09-64f8c3ca5596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ffe6a9f5f245e89b4666050303d6dc, user_id=91f6a7ce1d074f4ca0286e31fd8386da, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:01.427731 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a3cd0-7545-4058-ae09-64f8c3ca5596 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:01.440173 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1411/2839] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:39:01 2022] PUT /identity/v3/projects/f7ffe6a9f5f245e89b4666050303d6dc/users/91f6a7ce1d074f4ca0286e31fd8386da/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:01.445071 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e038c-97dc-46a1-943a-c3c4b789bad5 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.445362 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e038c-97dc-46a1-943a-c3c4b789bad5 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.445643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e038c-97dc-46a1-943a-c3c4b789bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.463247 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-2a4e038c-97dc-46a1-943a-c3c4b789bad5 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:01.465033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2a4e038c-97dc-46a1-943a-c3c4b789bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:01.518913 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1429/2840] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:01.529057 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a3cd0-7545-4058-ae09-64f8c3ca5596 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:01.530794 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-529a3cd0-7545-4058-ae09-64f8c3ca5596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:01.586512 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a3cd0-7545-4058-ae09-64f8c3ca5596 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:01.590602 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a223c-a16b-4fc9-8d7e-560490930be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:01.591237 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a223c-a16b-4fc9-8d7e-560490930be8 service neutron] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:01.591517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a223c-a16b-4fc9-8d7e-560490930be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:01.591787 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a223c-a16b-4fc9-8d7e-560490930be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:01.600420 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a223c-a16b-4fc9-8d7e-560490930be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:01.601840 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a223c-a16b-4fc9-8d7e-560490930be8 service neutron] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:01.611363 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1412/2841] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:02.180479 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a627b-8269-4065-b090-b06482d3dc7b None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:02.181045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a627b-8269-4065-b090-b06482d3dc7b None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:02.181045 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a627b-8269-4065-b090-b06482d3dc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:02.207053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-f14a627b-8269-4065-b090-b06482d3dc7b None None] MFA Rules not processed for user `91f6a7ce1d074f4ca0286e31fd8386da`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:02.208257 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-f14a627b-8269-4065-b090-b06482d3dc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:02.274417 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1430/2842] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:02.279815 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a223c-a16b-4fc9-8d7e-560490930be8 service neutron] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:02.289224 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a223c-a16b-4fc9-8d7e-560490930be8 service neutron] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:02.294199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8c0ad-7b4d-4c8a-a8a1-c48f800c561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:02.294853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c0ad-7b4d-4c8a-a8a1-c48f800c561f admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:02.295131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c0ad-7b4d-4c8a-a8a1-c48f800c561f admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:02.295402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c0ad-7b4d-4c8a-a8a1-c48f800c561f admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:02.296093 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8c0ad-7b4d-4c8a-a8a1-c48f800c561f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:02.297975 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8c0ad-7b4d-4c8a-a8a1-c48f800c561f admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:02.324715 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1413/2843] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:39:02 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:39:02.328609 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a627b-8269-4065-b090-b06482d3dc7b None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:02.339699 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a627b-8269-4065-b090-b06482d3dc7b None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:02.393465 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667874a-541e-44d6-8542-cbf0a40d77e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:02.394060 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667874a-541e-44d6-8542-cbf0a40d77e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:02.394372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667874a-541e-44d6-8542-cbf0a40d77e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:02.394663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667874a-541e-44d6-8542-cbf0a40d77e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:02.395321 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667874a-541e-44d6-8542-cbf0a40d77e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:02.397471 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667874a-541e-44d6-8542-cbf0a40d77e1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:02.417476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1431/2844] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:39:02 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:39:02.421503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8c0ad-7b4d-4c8a-a8a1-c48f800c561f admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:02.431532 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8c0ad-7b4d-4c8a-a8a1-c48f800c561f admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:02.436022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11ffb2-12d7-4e30-862d-6668b4d17930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:02.436667 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11ffb2-12d7-4e30-862d-6668b4d17930 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:02.436947 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11ffb2-12d7-4e30-862d-6668b4d17930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:02.437282 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11ffb2-12d7-4e30-862d-6668b4d17930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:02.437992 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11ffb2-12d7-4e30-862d-6668b4d17930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:02.439670 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11ffb2-12d7-4e30-862d-6668b4d17930 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:02.450524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1414/2845] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:39:02.454664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667874a-541e-44d6-8542-cbf0a40d77e1 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:02.465053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667874a-541e-44d6-8542-cbf0a40d77e1 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:02.469597 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d72a9-1dd0-489c-888a-99a4cd315699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:02.470514 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d72a9-1dd0-489c-888a-99a4cd315699 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:02.470799 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d72a9-1dd0-489c-888a-99a4cd315699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:02.471075 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d72a9-1dd0-489c-888a-99a4cd315699 admin admin] PATH_INFO: `/v3/projects/3f440a9217e34d81a1b914e03092f56e/users/f22888f8b2e74fb18289b59730d01b25/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:02.484919 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d72a9-1dd0-489c-888a-99a4cd315699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f440a9217e34d81a1b914e03092f56e, user_id=f22888f8b2e74fb18289b59730d01b25, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:02.487561 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d72a9-1dd0-489c-888a-99a4cd315699 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:02.499733 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1432/2846] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:39:02 2022] PUT /identity/v3/projects/3f440a9217e34d81a1b914e03092f56e/users/f22888f8b2e74fb18289b59730d01b25/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:39:02.503653 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11ffb2-12d7-4e30-862d-6668b4d17930 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:02.514189 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11ffb2-12d7-4e30-862d-6668b4d17930 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:02.569365 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564ca7a-5fb8-41f4-bd2c-3ba7816813e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:02.570028 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564ca7a-5fb8-41f4-bd2c-3ba7816813e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:02.570346 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564ca7a-5fb8-41f4-bd2c-3ba7816813e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:02.570624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564ca7a-5fb8-41f4-bd2c-3ba7816813e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:02.571414 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564ca7a-5fb8-41f4-bd2c-3ba7816813e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:02.573517 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564ca7a-5fb8-41f4-bd2c-3ba7816813e8 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:02.583131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1415/2847] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 17:39:02.587480 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d72a9-1dd0-489c-888a-99a4cd315699 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:02.598053 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d72a9-1dd0-489c-888a-99a4cd315699 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:02.602632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18b238-9da2-476d-8e8b-35439aa1ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:02.603502 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18b238-9da2-476d-8e8b-35439aa1ec46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:02.603788 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18b238-9da2-476d-8e8b-35439aa1ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:02.604065 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18b238-9da2-476d-8e8b-35439aa1ec46 admin admin] PATH_INFO: `/v3/projects/3f440a9217e34d81a1b914e03092f56e/users/f22888f8b2e74fb18289b59730d01b25/roles/d2d90e2ef72544ee8617f2b7789c6d78` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:02.606006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18b238-9da2-476d-8e8b-35439aa1ec46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f440a9217e34d81a1b914e03092f56e, user_id=f22888f8b2e74fb18289b59730d01b25, role_id=d2d90e2ef72544ee8617f2b7789c6d78)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:02.608650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18b238-9da2-476d-8e8b-35439aa1ec46 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:02.618567 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1433/2848] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:39:02 2022] PUT /identity/v3/projects/3f440a9217e34d81a1b914e03092f56e/users/f22888f8b2e74fb18289b59730d01b25/roles/d2d90e2ef72544ee8617f2b7789c6d78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:03.194492 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643046b-3f20-4dba-b407-013647dc3868 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:03.194813 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643046b-3f20-4dba-b407-013647dc3868 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:03.195102 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643046b-3f20-4dba-b407-013647dc3868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:03.221109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-0643046b-3f20-4dba-b407-013647dc3868 None None] MFA Rules not processed for user `f22888f8b2e74fb18289b59730d01b25`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:03.222480 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0643046b-3f20-4dba-b407-013647dc3868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:03.293718 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1416/2849] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:03.305033 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18b238-9da2-476d-8e8b-35439aa1ec46 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:03.308389 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-6e18b238-9da2-476d-8e8b-35439aa1ec46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:03.369831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18b238-9da2-476d-8e8b-35439aa1ec46 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:03.373393 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3ea7d-c676-43df-86ce-417bee9a19c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:03.374040 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3ea7d-c676-43df-86ce-417bee9a19c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:03.374783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3ea7d-c676-43df-86ce-417bee9a19c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:03.375072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3ea7d-c676-43df-86ce-417bee9a19c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:03.432287 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3ea7d-c676-43df-86ce-417bee9a19c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:03.433643 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3ea7d-c676-43df-86ce-417bee9a19c9 service cinder] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:03.442214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1434/2850] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:04.764239 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643046b-3f20-4dba-b407-013647dc3868 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:04.765655 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0643046b-3f20-4dba-b407-013647dc3868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:04.777717 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643046b-3f20-4dba-b407-013647dc3868 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:04.781279 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c8cc5-fe1b-445e-8692-0a896cbf4eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:04.781911 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8cc5-fe1b-445e-8692-0a896cbf4eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:04.782234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8cc5-fe1b-445e-8692-0a896cbf4eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:04.782510 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8cc5-fe1b-445e-8692-0a896cbf4eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:04.791301 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c8cc5-fe1b-445e-8692-0a896cbf4eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:04.793250 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c8cc5-fe1b-445e-8692-0a896cbf4eb1 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:04.802529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1417/2851] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:17.711769 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3ea7d-c676-43df-86ce-417bee9a19c9 service cinder] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:17.773953 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3ea7d-c676-43df-86ce-417bee9a19c9 service cinder] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:17.778545 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:17.779411 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:17.779694 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:17.779970 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] PATH_INFO: `/v3/users/91f6a7ce1d074f4ca0286e31fd8386da` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:17.781130 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f6a7ce1d074f4ca0286e31fd8386da)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:17.783094 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:17.826829 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f6a7ce1d074f4ca0286e31fd8386da'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:17.833256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f6a7ce1d074f4ca0286e31fd8386da'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:17.840576 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f6a7ce1d074f4ca0286e31fd8386da'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:17.841278 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f6a7ce1d074f4ca0286e31fd8386da'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:17.841882 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f6a7ce1d074f4ca0286e31fd8386da'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:17.858945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1435/2852] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:39:17 2022] DELETE /identity/v3/users/91f6a7ce1d074f4ca0286e31fd8386da => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:18.024234 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c8cc5-fe1b-445e-8692-0a896cbf4eb1 service cinder] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:18.034994 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c8cc5-fe1b-445e-8692-0a896cbf4eb1 service cinder] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:18.088054 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:18.089483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.089759 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.090029 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] PATH_INFO: `/v3/projects/f7ffe6a9f5f245e89b4666050303d6dc` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.091293 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ffe6a9f5f245e89b4666050303d6dc)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:18.093107 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:18.135846 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ffe6a9f5f245e89b4666050303d6dc', 'request_id': 'req-e08c2f74-e13f-49c7-8da5-ec63726fbf43'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.141713 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ffe6a9f5f245e89b4666050303d6dc', 'request_id': 'req-e08c2f74-e13f-49c7-8da5-ec63726fbf43'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.148907 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ffe6a9f5f245e89b4666050303d6dc', 'request_id': 'req-e08c2f74-e13f-49c7-8da5-ec63726fbf43'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.159707 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] The token cache is being invalidate because project f7ffe6a9f5f245e89b4666050303d6dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:39:18.159998 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.160625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.162133 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1418/2853] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:39:18 2022] DELETE /identity/v3/projects/f7ffe6a9f5f245e89b4666050303d6dc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:18.166237 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:18.167641 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:18.180317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf282c33-a9a8-4294-b35e-a51ef5d712cb admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:18.234729 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:18.235605 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.235892 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.236169 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] PATH_INFO: `/v3/users/f22888f8b2e74fb18289b59730d01b25` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.237344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22888f8b2e74fb18289b59730d01b25)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:18.239330 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:18.283558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22888f8b2e74fb18289b59730d01b25'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.290190 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22888f8b2e74fb18289b59730d01b25'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.297693 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22888f8b2e74fb18289b59730d01b25'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.298337 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22888f8b2e74fb18289b59730d01b25'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.299027 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-2bd294f7-36e1-47a5-8938-055de4a948ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22888f8b2e74fb18289b59730d01b25'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.316212 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1436/2854] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:39:18 2022] DELETE /identity/v3/users/f22888f8b2e74fb18289b59730d01b25 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:18.477508 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:18.479167 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:18.491674 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c2f74-e13f-49c7-8da5-ec63726fbf43 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:18.546749 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:18.547600 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.547881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.548154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] PATH_INFO: `/v3/projects/3f440a9217e34d81a1b914e03092f56e` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.549323 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f440a9217e34d81a1b914e03092f56e)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:18.551240 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:18.595483 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f440a9217e34d81a1b914e03092f56e', 'request_id': 'req-774996fe-524a-4ba6-993f-3192a224639c'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.601197 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f440a9217e34d81a1b914e03092f56e', 'request_id': 'req-774996fe-524a-4ba6-993f-3192a224639c'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.607956 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f440a9217e34d81a1b914e03092f56e', 'request_id': 'req-774996fe-524a-4ba6-993f-3192a224639c'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.617503 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] The token cache is being invalidate because project 3f440a9217e34d81a1b914e03092f56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:39:18.617726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.618339 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-774996fe-524a-4ba6-993f-3192a224639c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:18.620364 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1419/2855] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:39:18 2022] DELETE /identity/v3/projects/3f440a9217e34d81a1b914e03092f56e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:18.625184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e3a03-e283-4543-acd2-30344f29b8c9 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.625473 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e3a03-e283-4543-acd2-30344f29b8c9 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.625749 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e3a03-e283-4543-acd2-30344f29b8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.643757 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-8c0e3a03-e283-4543-acd2-30344f29b8c9 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:18.644934 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-8c0e3a03-e283-4543-acd2-30344f29b8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:18.701197 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1437/2856] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:18.709035 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61c9a6-25d1-4c95-a61e-1ac7a09a84cc None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.709331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61c9a6-25d1-4c95-a61e-1ac7a09a84cc None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.709625 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61c9a6-25d1-4c95-a61e-1ac7a09a84cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.728416 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-ca61c9a6-25d1-4c95-a61e-1ac7a09a84cc None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:18.730207 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-ca61c9a6-25d1-4c95-a61e-1ac7a09a84cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:18.738142 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1420/2857] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:18.742498 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e3a03-e283-4543-acd2-30344f29b8c9 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:18.752632 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e3a03-e283-4543-acd2-30344f29b8c9 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:18.757184 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f719b-be86-4b98-b951-f388c5aae537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:18.757832 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f719b-be86-4b98-b951-f388c5aae537 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.758135 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f719b-be86-4b98-b951-f388c5aae537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.758422 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f719b-be86-4b98-b951-f388c5aae537 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.759137 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f719b-be86-4b98-b951-f388c5aae537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:39:18.759437 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f719b-be86-4b98-b951-f388c5aae537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:18.761009 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f719b-be86-4b98-b951-f388c5aae537 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:18.772441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1438/2858] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:39:18.776737 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61c9a6-25d1-4c95-a61e-1ac7a09a84cc None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:18.785726 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61c9a6-25d1-4c95-a61e-1ac7a09a84cc None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:18.790387 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf26be1-6261-439f-b9b3-79607821b1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:18.791025 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf26be1-6261-439f-b9b3-79607821b1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.791310 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf26be1-6261-439f-b9b3-79607821b1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.792127 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf26be1-6261-439f-b9b3-79607821b1b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.792823 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf26be1-6261-439f-b9b3-79607821b1b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:18.794758 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf26be1-6261-439f-b9b3-79607821b1b5 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:18.819856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1421/2859] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:39:18 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:39:18.823734 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f719b-be86-4b98-b951-f388c5aae537 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:18.833584 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f719b-be86-4b98-b951-f388c5aae537 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:18.887778 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994548b4-371f-4e55-b613-f85432943826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:18.888384 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994548b4-371f-4e55-b613-f85432943826 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.888672 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994548b4-371f-4e55-b613-f85432943826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.888945 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994548b4-371f-4e55-b613-f85432943826 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.889642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994548b4-371f-4e55-b613-f85432943826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:18.891583 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994548b4-371f-4e55-b613-f85432943826 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:18.910515 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1439/2860] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:39:18 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:39:18.914656 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf26be1-6261-439f-b9b3-79607821b1b5 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:18.925331 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf26be1-6261-439f-b9b3-79607821b1b5 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:18.929886 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dfd1d-d719-4d49-af20-b4aa70f203cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:18.930567 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dfd1d-d719-4d49-af20-b4aa70f203cc admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.930849 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dfd1d-d719-4d49-af20-b4aa70f203cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.931122 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dfd1d-d719-4d49-af20-b4aa70f203cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.931833 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dfd1d-d719-4d49-af20-b4aa70f203cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:18.934013 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dfd1d-d719-4d49-af20-b4aa70f203cc admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:18.944486 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1422/2861] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:39:18.949154 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994548b4-371f-4e55-b613-f85432943826 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:18.958993 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994548b4-371f-4e55-b613-f85432943826 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:18.964640 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1d4a8-a2f0-4adc-bb06-9b64eabfe1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:18.965294 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1d4a8-a2f0-4adc-bb06-9b64eabfe1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.965581 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1d4a8-a2f0-4adc-bb06-9b64eabfe1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.965858 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1d4a8-a2f0-4adc-bb06-9b64eabfe1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:18.966684 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1d4a8-a2f0-4adc-bb06-9b64eabfe1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:18.968267 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1d4a8-a2f0-4adc-bb06-9b64eabfe1f9 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:18.977834 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1440/2862] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:39:18.981890 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dfd1d-d719-4d49-af20-b4aa70f203cc admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:18.991402 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dfd1d-d719-4d49-af20-b4aa70f203cc admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:18.996089 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5180a5-0630-4cf1-8735-82d7e8caeb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:18.996955 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5180a5-0630-4cf1-8735-82d7e8caeb40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:18.997231 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5180a5-0630-4cf1-8735-82d7e8caeb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:18.997502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5180a5-0630-4cf1-8735-82d7e8caeb40 admin admin] PATH_INFO: `/v3/projects/7f1b94dae64b42c8b2e9145154afdab8/users/88abc4cec23241009dc5ed35356841c2/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:19.013421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5180a5-0630-4cf1-8735-82d7e8caeb40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1b94dae64b42c8b2e9145154afdab8, user_id=88abc4cec23241009dc5ed35356841c2, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:19.016104 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5180a5-0630-4cf1-8735-82d7e8caeb40 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:19.029226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1423/2863] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:39:18 2022] PUT /identity/v3/projects/7f1b94dae64b42c8b2e9145154afdab8/users/88abc4cec23241009dc5ed35356841c2/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:19.039523 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514cedf-ad81-4fbb-bedc-b5a51b3fb69f None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:19.039823 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514cedf-ad81-4fbb-bedc-b5a51b3fb69f None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:19.040107 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514cedf-ad81-4fbb-bedc-b5a51b3fb69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:19.066493 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-c514cedf-ad81-4fbb-bedc-b5a51b3fb69f None None] MFA Rules not processed for user `88abc4cec23241009dc5ed35356841c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:19.067738 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-c514cedf-ad81-4fbb-bedc-b5a51b3fb69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:19.129126 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1441/2864] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:19.140996 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5180a5-0630-4cf1-8735-82d7e8caeb40 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:19.142645 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cf5180a5-0630-4cf1-8735-82d7e8caeb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:19.201548 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5180a5-0630-4cf1-8735-82d7e8caeb40 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:19.205199 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd52bc6-201d-488a-a443-b3cb0bf23737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:19.205853 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd52bc6-201d-488a-a443-b3cb0bf23737 service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:19.206168 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd52bc6-201d-488a-a443-b3cb0bf23737 service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:19.206447 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd52bc6-201d-488a-a443-b3cb0bf23737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:19.214561 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd52bc6-201d-488a-a443-b3cb0bf23737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:19.215974 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd52bc6-201d-488a-a443-b3cb0bf23737 service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:19.224499 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1424/2865] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:19.243242 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514cedf-ad81-4fbb-bedc-b5a51b3fb69f None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:19.302564 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514cedf-ad81-4fbb-bedc-b5a51b3fb69f None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:19.307689 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:19.308558 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:19.308839 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:19.309115 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] PATH_INFO: `/v3/users/88abc4cec23241009dc5ed35356841c2` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:19.310340 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88abc4cec23241009dc5ed35356841c2)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:19.312240 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:19.355865 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88abc4cec23241009dc5ed35356841c2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.362650 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88abc4cec23241009dc5ed35356841c2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.371005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88abc4cec23241009dc5ed35356841c2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.371662 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88abc4cec23241009dc5ed35356841c2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.372274 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88abc4cec23241009dc5ed35356841c2'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.389076 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1442/2866] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:39:19 2022] DELETE /identity/v3/users/88abc4cec23241009dc5ed35356841c2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:19.393552 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd178f-c55d-4a8a-9d06-4fd1a95cb633 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:19.393789 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd178f-c55d-4a8a-9d06-4fd1a95cb633 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:19.394070 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd178f-c55d-4a8a-9d06-4fd1a95cb633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:19.411246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-41dd178f-c55d-4a8a-9d06-4fd1a95cb633 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:19.412418 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-41dd178f-c55d-4a8a-9d06-4fd1a95cb633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:19.467324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1425/2867] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:19.476928 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:19.478452 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:19.535005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a972a99-0394-46dd-8b4b-4bec94cd8134 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:19.538614 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44072ddc-ff7a-44f3-956e-84cb8327f2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:19.539256 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44072ddc-ff7a-44f3-956e-84cb8327f2de service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:19.539540 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44072ddc-ff7a-44f3-956e-84cb8327f2de service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:19.539816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44072ddc-ff7a-44f3-956e-84cb8327f2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:19.549054 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44072ddc-ff7a-44f3-956e-84cb8327f2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:19.550517 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44072ddc-ff7a-44f3-956e-84cb8327f2de service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:19.560306 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1443/2868] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:19.811017 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd178f-c55d-4a8a-9d06-4fd1a95cb633 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:19.812502 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-41dd178f-c55d-4a8a-9d06-4fd1a95cb633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:19.824982 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd178f-c55d-4a8a-9d06-4fd1a95cb633 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:19.829636 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:19.830528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:19.830810 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:19.831081 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] PATH_INFO: `/v3/projects/7f1b94dae64b42c8b2e9145154afdab8` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:19.832307 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1b94dae64b42c8b2e9145154afdab8)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:19.834421 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:19.879128 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1b94dae64b42c8b2e9145154afdab8', 'request_id': 'req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.884922 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1b94dae64b42c8b2e9145154afdab8', 'request_id': 'req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.891870 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1b94dae64b42c8b2e9145154afdab8', 'request_id': 'req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.902773 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] The token cache is being invalidate because project 7f1b94dae64b42c8b2e9145154afdab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:39:19.903003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.903621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-4f51dbad-5c1d-4ffc-b8c1-c8451bdf8522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:19.905120 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1426/2869] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:39:19 2022] DELETE /identity/v3/projects/7f1b94dae64b42c8b2e9145154afdab8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:19.909878 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8e4f-353a-44b8-9cf1-b786fe24d7bf None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:19.910396 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8e4f-353a-44b8-9cf1-b786fe24d7bf None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:19.910509 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8e4f-353a-44b8-9cf1-b786fe24d7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:19.928497 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e5ab8e4f-353a-44b8-9cf1-b786fe24d7bf None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:19.929680 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e5ab8e4f-353a-44b8-9cf1-b786fe24d7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:19.986831 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1444/2870] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:20.045484 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3210d5-744e-4335-b35b-6c4733c5eff6 None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:20.046047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3210d5-744e-4335-b35b-6c4733c5eff6 None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:20.046047 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3210d5-744e-4335-b35b-6c4733c5eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:20.064160 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-0d3210d5-744e-4335-b35b-6c4733c5eff6 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:20.065352 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-0d3210d5-744e-4335-b35b-6c4733c5eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:20.073324 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1427/2871] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:20.077773 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab8e4f-353a-44b8-9cf1-b786fe24d7bf None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:20.087395 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab8e4f-353a-44b8-9cf1-b786fe24d7bf None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:20.092476 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e051e6-b6a2-415d-a962-e509f503a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:20.093123 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e051e6-b6a2-415d-a962-e509f503a08b admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:20.093408 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e051e6-b6a2-415d-a962-e509f503a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:20.093685 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e051e6-b6a2-415d-a962-e509f503a08b admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:20.094438 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e051e6-b6a2-415d-a962-e509f503a08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:39:20.094745 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e051e6-b6a2-415d-a962-e509f503a08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:20.096317 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e051e6-b6a2-415d-a962-e509f503a08b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:20.108114 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1445/2872] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 17:39:20.112272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3210d5-744e-4335-b35b-6c4733c5eff6 None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:20.121233 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3210d5-744e-4335-b35b-6c4733c5eff6 None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:20.125856 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940d7c9-5444-4460-9663-15042bdf9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:20.126529 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940d7c9-5444-4460-9663-15042bdf9da0 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:20.126818 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940d7c9-5444-4460-9663-15042bdf9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:20.127098 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940d7c9-5444-4460-9663-15042bdf9da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:20.127786 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940d7c9-5444-4460-9663-15042bdf9da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:20.129678 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940d7c9-5444-4460-9663-15042bdf9da0 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:20.154463 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1428/2873] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:39:20 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:39:20.159057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e051e6-b6a2-415d-a962-e509f503a08b admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:20.169803 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e051e6-b6a2-415d-a962-e509f503a08b admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:20.222319 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c2328-d955-4de9-97c6-0fc6e19cb640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:20.222978 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c2328-d955-4de9-97c6-0fc6e19cb640 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:20.223259 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c2328-d955-4de9-97c6-0fc6e19cb640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:20.223532 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c2328-d955-4de9-97c6-0fc6e19cb640 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:20.224214 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c2328-d955-4de9-97c6-0fc6e19cb640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:20.226088 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c2328-d955-4de9-97c6-0fc6e19cb640 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:20.245664 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1446/2874] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:39:20 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:39:20.249949 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940d7c9-5444-4460-9663-15042bdf9da0 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:20.260844 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940d7c9-5444-4460-9663-15042bdf9da0 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:20.265382 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1c458-cb81-4062-8a09-73344fdebfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:20.266022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1c458-cb81-4062-8a09-73344fdebfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:20.266330 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1c458-cb81-4062-8a09-73344fdebfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:20.266605 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1c458-cb81-4062-8a09-73344fdebfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:20.267318 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1c458-cb81-4062-8a09-73344fdebfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:20.268984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1c458-cb81-4062-8a09-73344fdebfc1 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:20.279909 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1429/2875] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:39:20.283663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c2328-d955-4de9-97c6-0fc6e19cb640 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:20.293466 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c2328-d955-4de9-97c6-0fc6e19cb640 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:20.298092 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4465a-1a4a-4068-8cdb-c093a7a6b46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:20.298780 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4465a-1a4a-4068-8cdb-c093a7a6b46b admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:20.299066 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4465a-1a4a-4068-8cdb-c093a7a6b46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:20.299344 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4465a-1a4a-4068-8cdb-c093a7a6b46b admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:20.300062 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4465a-1a4a-4068-8cdb-c093a7a6b46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:20.301670 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4465a-1a4a-4068-8cdb-c093a7a6b46b admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:20.311700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1447/2876] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:39:20.315745 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1c458-cb81-4062-8a09-73344fdebfc1 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:20.325983 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1c458-cb81-4062-8a09-73344fdebfc1 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:20.330869 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395486cd-0925-497f-a139-32d1d9508066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:20.331748 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395486cd-0925-497f-a139-32d1d9508066 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:20.332034 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395486cd-0925-497f-a139-32d1d9508066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:20.332315 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395486cd-0925-497f-a139-32d1d9508066 admin admin] PATH_INFO: `/v3/projects/e5dfdccbba29499bad58edba2256379a/users/38f9f487bfc6446b8a22324d25b5dcae/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:20.347069 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395486cd-0925-497f-a139-32d1d9508066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5dfdccbba29499bad58edba2256379a, user_id=38f9f487bfc6446b8a22324d25b5dcae, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:20.349720 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395486cd-0925-497f-a139-32d1d9508066 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:20.362297 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1430/2877] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:39:20 2022] PUT /identity/v3/projects/e5dfdccbba29499bad58edba2256379a/users/38f9f487bfc6446b8a22324d25b5dcae/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:20.372125 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e0e2-7c8d-4a58-80ec-f6a0b541a399 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:20.372424 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e0e2-7c8d-4a58-80ec-f6a0b541a399 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:20.372705 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e0e2-7c8d-4a58-80ec-f6a0b541a399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:20.399229 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-e8e2e0e2-7c8d-4a58-80ec-f6a0b541a399 None None] MFA Rules not processed for user `38f9f487bfc6446b8a22324d25b5dcae`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:20.400461 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e8e2e0e2-7c8d-4a58-80ec-f6a0b541a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:20.464056 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1448/2878] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:20.474881 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395486cd-0925-497f-a139-32d1d9508066 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:20.476540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-395486cd-0925-497f-a139-32d1d9508066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:20.530937 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395486cd-0925-497f-a139-32d1d9508066 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:20.534524 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218adf1-925c-4745-96cb-120f09e9d33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:20.535186 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218adf1-925c-4745-96cb-120f09e9d33e service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:20.535464 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218adf1-925c-4745-96cb-120f09e9d33e service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:20.535740 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218adf1-925c-4745-96cb-120f09e9d33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:20.543754 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218adf1-925c-4745-96cb-120f09e9d33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:20.545154 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218adf1-925c-4745-96cb-120f09e9d33e service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:20.553676 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1431/2879] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:28.848458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e0e2-7c8d-4a58-80ec-f6a0b541a399 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:28.907550 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e0e2-7c8d-4a58-80ec-f6a0b541a399 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:28.912030 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:28.912895 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:28.913176 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:28.913441 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] PATH_INFO: `/v3/users/38f9f487bfc6446b8a22324d25b5dcae` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:28.914615 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f9f487bfc6446b8a22324d25b5dcae)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:28.916505 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:28.960875 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f9f487bfc6446b8a22324d25b5dcae'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:28.967884 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f9f487bfc6446b8a22324d25b5dcae'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:28.974595 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f9f487bfc6446b8a22324d25b5dcae'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:28.975194 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f9f487bfc6446b8a22324d25b5dcae'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:28.975783 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f9f487bfc6446b8a22324d25b5dcae'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:28.991820 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1449/2880] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:39:28 2022] DELETE /identity/v3/users/38f9f487bfc6446b8a22324d25b5dcae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 17:39:28.997003 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc92088-0105-4f57-8807-3e68d03ea19c None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:28.997475 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc92088-0105-4f57-8807-3e68d03ea19c None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:28.997588 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc92088-0105-4f57-8807-3e68d03ea19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.020196 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-fcc92088-0105-4f57-8807-3e68d03ea19c None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:29.021639 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fcc92088-0105-4f57-8807-3e68d03ea19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:29.079380 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1432/2881] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 17:39:29.089048 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:29.090477 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:29.145435 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501ceac-3d98-4b63-a14f-07291493b049 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:29.149361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461842b-efa1-410e-9b26-d40357ba86eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:29.150006 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461842b-efa1-410e-9b26-d40357ba86eb service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.150328 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461842b-efa1-410e-9b26-d40357ba86eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.150613 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461842b-efa1-410e-9b26-d40357ba86eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.160011 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461842b-efa1-410e-9b26-d40357ba86eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:29.161464 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461842b-efa1-410e-9b26-d40357ba86eb service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:29.171353 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1450/2882] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:29.427627 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc92088-0105-4f57-8807-3e68d03ea19c None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:29.429019 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-fcc92088-0105-4f57-8807-3e68d03ea19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:29.442857 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc92088-0105-4f57-8807-3e68d03ea19c None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:29.447680 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:29.448540 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.448854 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.449131 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] PATH_INFO: `/v3/projects/e5dfdccbba29499bad58edba2256379a` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.450449 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5dfdccbba29499bad58edba2256379a)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:29.452415 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:29.497396 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5dfdccbba29499bad58edba2256379a', 'request_id': 'req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:29.503652 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5dfdccbba29499bad58edba2256379a', 'request_id': 'req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:29.510322 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5dfdccbba29499bad58edba2256379a', 'request_id': 'req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:29.520226 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] The token cache is being invalidate because project e5dfdccbba29499bad58edba2256379a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:39:29.520511 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:29.521138 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-35a5f7a0-1867-4889-9007-fc1ecfc4cc8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:29.522942 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1433/2883] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:39:29 2022] DELETE /identity/v3/projects/e5dfdccbba29499bad58edba2256379a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:29.527816 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e784878-0583-4213-b3e6-1dd710c071c2 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.528108 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e784878-0583-4213-b3e6-1dd710c071c2 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.528392 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e784878-0583-4213-b3e6-1dd710c071c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.546315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-0e784878-0583-4213-b3e6-1dd710c071c2 None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:29.547503 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-0e784878-0583-4213-b3e6-1dd710c071c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:29.604292 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1451/2884] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:29.612649 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f658-5305-4fb2-b3e8-afa3e9150ddd None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.612939 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f658-5305-4fb2-b3e8-afa3e9150ddd None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.613217 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f658-5305-4fb2-b3e8-afa3e9150ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.630816 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-cf34f658-5305-4fb2-b3e8-afa3e9150ddd None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:29.631984 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cf34f658-5305-4fb2-b3e8-afa3e9150ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:29.639728 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1434/2885] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:29.643698 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e784878-0583-4213-b3e6-1dd710c071c2 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:29.653903 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e784878-0583-4213-b3e6-1dd710c071c2 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:29.658416 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b83ab-a0e5-45c1-af40-0a825e967357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:29.659057 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b83ab-a0e5-45c1-af40-0a825e967357 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.659366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b83ab-a0e5-45c1-af40-0a825e967357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.659642 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b83ab-a0e5-45c1-af40-0a825e967357 admin admin] PATH_INFO: `/v3/domains` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.660350 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b83ab-a0e5-45c1-af40-0a825e967357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79406) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 17:39:29.660656 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b83ab-a0e5-45c1-af40-0a825e967357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:29.662253 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b83ab-a0e5-45c1-af40-0a825e967357 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:29.674282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1452/2886] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Mar 10 17:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 17:39:29.678264 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f658-5305-4fb2-b3e8-afa3e9150ddd None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:29.687149 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f658-5305-4fb2-b3e8-afa3e9150ddd None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:29.691624 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba777ef-29ab-4f6d-8ae4-bbf08fc138f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:29.692254 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba777ef-29ab-4f6d-8ae4-bbf08fc138f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.692545 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba777ef-29ab-4f6d-8ae4-bbf08fc138f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.692802 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba777ef-29ab-4f6d-8ae4-bbf08fc138f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.693482 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba777ef-29ab-4f6d-8ae4-bbf08fc138f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:29.695393 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba777ef-29ab-4f6d-8ae4-bbf08fc138f1 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:29.719689 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1435/2887] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Mar 10 17:39:29 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 17:39:29.723663 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b83ab-a0e5-45c1-af40-0a825e967357 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:29.733786 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b83ab-a0e5-45c1-af40-0a825e967357 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:29.787098 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2a90a-1227-4441-8760-4c8ede52cd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:29.787758 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2a90a-1227-4441-8760-4c8ede52cd80 admin admin] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.788040 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2a90a-1227-4441-8760-4c8ede52cd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.788315 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2a90a-1227-4441-8760-4c8ede52cd80 admin admin] PATH_INFO: `/v3/users` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.789000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2a90a-1227-4441-8760-4c8ede52cd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:29.790917 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2a90a-1227-4441-8760-4c8ede52cd80 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:29.810313 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1453/2888] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Mar 10 17:39:29 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 17:39:29.814222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba777ef-29ab-4f6d-8ae4-bbf08fc138f1 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:29.824598 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba777ef-29ab-4f6d-8ae4-bbf08fc138f1 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:29.829092 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04d28-8cea-4624-b0b5-13f3004a7458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:29.829735 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04d28-8cea-4624-b0b5-13f3004a7458 admin admin] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.830012 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04d28-8cea-4624-b0b5-13f3004a7458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.830314 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04d28-8cea-4624-b0b5-13f3004a7458 admin admin] PATH_INFO: `/v3/roles` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.831022 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f04d28-8cea-4624-b0b5-13f3004a7458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:29.832590 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f04d28-8cea-4624-b0b5-13f3004a7458 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:29.842516 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1436/2889] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:39:29.846097 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2a90a-1227-4441-8760-4c8ede52cd80 admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:29.855849 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2a90a-1227-4441-8760-4c8ede52cd80 admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:29.860403 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec59aeb-dc19-41d4-9d64-bb40110e39b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:29.861072 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec59aeb-dc19-41d4-9d64-bb40110e39b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.861358 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec59aeb-dc19-41d4-9d64-bb40110e39b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.861637 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec59aeb-dc19-41d4-9d64-bb40110e39b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.862427 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec59aeb-dc19-41d4-9d64-bb40110e39b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:29.863987 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec59aeb-dc19-41d4-9d64-bb40110e39b1 admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:29.874041 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1454/2890] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Mar 10 17:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 17:39:29.878222 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04d28-8cea-4624-b0b5-13f3004a7458 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:29.888859 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04d28-8cea-4624-b0b5-13f3004a7458 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:29.893408 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24a9ca-c25b-4732-b43a-37271b6a6a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:29.894336 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24a9ca-c25b-4732-b43a-37271b6a6a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.894616 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24a9ca-c25b-4732-b43a-37271b6a6a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.894889 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24a9ca-c25b-4732-b43a-37271b6a6a21 admin admin] PATH_INFO: `/v3/projects/df6fbacfd2224e35bd1827f0988ecce2/users/1370096408e2481ea733afff15c0d8f7/roles/43e227d04ba64588acce441d98a394f3` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.908892 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24a9ca-c25b-4732-b43a-37271b6a6a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6fbacfd2224e35bd1827f0988ecce2, user_id=1370096408e2481ea733afff15c0d8f7, role_id=43e227d04ba64588acce441d98a394f3)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:29.911589 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24a9ca-c25b-4732-b43a-37271b6a6a21 admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:29.924693 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1437/2891] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Mar 10 17:39:29 2022] PUT /identity/v3/projects/df6fbacfd2224e35bd1827f0988ecce2/users/1370096408e2481ea733afff15c0d8f7/roles/43e227d04ba64588acce441d98a394f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:29.936709 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71c882-4fba-4cfb-addf-659208533317 None None] REQUEST_METHOD: `POST` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:29.937000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71c882-4fba-4cfb-addf-659208533317 None None] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:29.937280 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71c882-4fba-4cfb-addf-659208533317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:29.965152 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.auth.core [None req-be71c882-4fba-4cfb-addf-659208533317 None None] MFA Rules not processed for user `1370096408e2481ea733afff15c0d8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79406) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:29.966359 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-be71c882-4fba-4cfb-addf-659208533317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:30.027673 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1455/2892] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:30.038751 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24a9ca-c25b-4732-b43a-37271b6a6a21 admin admin] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:30.040395 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-cb24a9ca-c25b-4732-b43a-37271b6a6a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:30.094325 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24a9ca-c25b-4732-b43a-37271b6a6a21 admin admin] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:30.097875 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a03633-cb4d-43e4-b604-60448723383e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f582002cd7141428072dacd218dbe86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:30.098554 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a03633-cb4d-43e4-b604-60448723383e service cinder] REQUEST_METHOD: `GET` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:30.098836 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a03633-cb4d-43e4-b604-60448723383e service cinder] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:30.099109 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a03633-cb4d-43e4-b604-60448723383e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:30.107659 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a03633-cb4d-43e4-b604-60448723383e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:30.109020 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a03633-cb4d-43e4-b604-60448723383e service cinder] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:30.117520 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1438/2893] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:32.631282 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71c882-4fba-4cfb-addf-659208533317 None None] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:32.690213 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71c882-4fba-4cfb-addf-659208533317 None None] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:32.694582 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:32.695442 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:32.695721 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:32.696000 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] PATH_INFO: `/v3/users/1370096408e2481ea733afff15c0d8f7` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:32.697156 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1370096408e2481ea733afff15c0d8f7)` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:32.699700 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:32.741458 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1370096408e2481ea733afff15c0d8f7'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:32.748361 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1370096408e2481ea733afff15c0d8f7'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:32.755230 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1370096408e2481ea733afff15c0d8f7'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:32.755847 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1370096408e2481ea733afff15c0d8f7'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:32.756468 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.notifications [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1370096408e2481ea733afff15c0d8f7'} {{(pid=79406) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:32.774171 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1456/2894] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Mar 10 17:39:32 2022] DELETE /identity/v3/users/1370096408e2481ea733afff15c0d8f7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:39:32.778621 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a936d-8918-4cf0-a6f5-89c431796e1e None None] REQUEST_METHOD: `POST` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:32.779095 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a936d-8918-4cf0-a6f5-89c431796e1e None None] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:32.779212 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a936d-8918-4cf0-a6f5-89c431796e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:32.795999 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.auth.core [None req-b03a936d-8918-4cf0-a6f5-89c431796e1e None None] MFA Rules not processed for user `fd873144a6ac489d9c499e77ba96e536`. Rule list: `[]` (Enabled: `True`). {{(pid=79405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 17:39:32.797176 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b03a936d-8918-4cf0-a6f5-89c431796e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:32.851888 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1439/2895] 10.222.0.16 () {58 vars in 957 bytes} [Thu Mar 10 17:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 17:39:32.862005 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:32.863382 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:32.918002 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b562d-7220-4a33-a65c-d322556b739d admin admin] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:32.921692 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d492a3f-e50a-4105-b158-dc842b36d8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '701c0e43cc30442582456f4f7153333a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:32.922366 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d492a3f-e50a-4105-b158-dc842b36d8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:32.922648 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d492a3f-e50a-4105-b158-dc842b36d8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:32.922923 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d492a3f-e50a-4105-b158-dc842b36d8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:32.931530 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d492a3f-e50a-4105-b158-dc842b36d8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:32.932949 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d492a3f-e50a-4105-b158-dc842b36d8f8 service neutron] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:32.941996 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1457/2896] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 17:39:33.196608 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a936d-8918-4cf0-a6f5-89c431796e1e None None] Authenticating user token {{(pid=79405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:39:33.198018 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.fernet_utils [None req-b03a936d-8918-4cf0-a6f5-89c431796e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:39:33.211272 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a936d-8918-4cf0-a6f5-89c431796e1e None None] Validating token access rules against request {{(pid=79405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:39:33.216397 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd873144a6ac489d9c499e77ba96e536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b6da1569d25429788d1024be5510eba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:39:33.217246 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:39:33.217528 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:39:33.217802 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] PATH_INFO: `/v3/projects/df6fbacfd2224e35bd1827f0988ecce2` {{(pid=79405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:39:33.219085 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6fbacfd2224e35bd1827f0988ecce2)` {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:39:33.220973 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] RBAC: Authorization granted {{(pid=79405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:39:33.265316 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6fbacfd2224e35bd1827f0988ecce2', 'request_id': 'req-edca42a7-06cd-4d6e-b846-eff90cd0be8e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:33.271535 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6fbacfd2224e35bd1827f0988ecce2', 'request_id': 'req-edca42a7-06cd-4d6e-b846-eff90cd0be8e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:33.278781 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6fbacfd2224e35bd1827f0988ecce2', 'request_id': 'req-edca42a7-06cd-4d6e-b846-eff90cd0be8e'} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:33.289153 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] The token cache is being invalidate because project df6fbacfd2224e35bd1827f0988ecce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 17:39:33.289435 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:33.290075 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: DEBUG keystone.notifications [None req-edca42a7-06cd-4d6e-b846-eff90cd0be8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 17:39:33.291663 dv-cinder-830538-8-iscsi devstack@keystone.service[79405]: [pid: 79405|app: 0|req: 1440/2897] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Mar 10 17:39:33 2022] DELETE /identity/v3/projects/df6fbacfd2224e35bd1827f0988ecce2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 17:43:47.455555 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d492a3f-e50a-4105-b158-dc842b36d8f8 service neutron] Authenticating user token {{(pid=79406) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 17:43:47.457600 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-7d492a3f-e50a-4105-b158-dc842b36d8f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:43:47.523371 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d492a3f-e50a-4105-b158-dc842b36d8f8 service neutron] Validating token access rules against request {{(pid=79406) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 17:43:47.578372 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa130c1-ac60-4973-88d7-d471ee70ec73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35ae873d42b490cae4dd610f2ac6a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eb8f16a150f41d7a69e6506654256ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79406) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 17:43:47.579016 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa130c1-ac60-4973-88d7-d471ee70ec73 service placement] REQUEST_METHOD: `GET` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 17:43:47.579301 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa130c1-ac60-4973-88d7-d471ee70ec73 service placement] SCRIPT_NAME: `/identity` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 17:43:47.579579 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa130c1-ac60-4973-88d7-d471ee70ec73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79406) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 17:43:47.581342 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.fernet_utils [None req-2fa130c1-ac60-4973-88d7-d471ee70ec73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79406) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 17:43:47.592100 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa130c1-ac60-4973-88d7-d471ee70ec73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 17:43:47.593661 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa130c1-ac60-4973-88d7-d471ee70ec73 service placement] RBAC: Authorization granted {{(pid=79406) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 17:43:47.603288 dv-cinder-830538-8-iscsi devstack@keystone.service[79406]: [pid: 79406|app: 0|req: 1458/2898] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Mar 10 17:43:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)